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SECTION I 

STUDIES OF MINIMAL ESSENTIALS IN 
ELEMENTARY SCHOOL SUBJECTS 

CHAPTER I 

SOME SOCIAL DEMANDS ON THE COURSE 
OF STUDY IN ARITHMETIC 



H. EDWIN" MITCHELL 

Department of Professional Training, Minnesota State Normal School, 
Moorhead, Minnesota. 



The following study 1 is presented to illustrate the use wMcli the 
author is making of the statistical method in discovering and in 
determining the relative importance of the varions content elements 
of the course of study in arithmetic. Some examples of content 
elements, illustrating what is meant by the term, are "1-6 gross/' 
"% cup," "% yard," "price per dozen," "4 5/12 dozen articles 
made," and "10% off regular price." An index of the relative 
importance, from the standpoint of social usage, of the different 
content elements is found in the frequency of their occurrence and 
in the manner of their use, i. e., whether used in computations 
or merely as descriptive terms. 

The data presented below are taken from four sources, viz., a 
standard cook book, the pay rolls of a number of artificial flower 
and feather factories, marked-down-sales advertisements, and a gen- 
eral hardware catalog. These data are, accordingly, concrete stuff 
out of which arise arithmetical problems of housewives, wage earn- 
ers, consumers, and retail hardware dealers, respectively. The 
data are typical of the sort which must be gathered from many 
sources and made the basis of selection of the problems and drill 
exercises which are to constitute the course of study in arithmetic. 

1 This report is part of a study carried on in Teachers College, under the 
direction of E. L. Thorndike, during the year 1916-1917. 
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SOCIAL DEMANDS ON STUDY IN ARITHMETIC g 

A, Data from Hie cook took. Table I gives tlie frequency 
of occurrence of cooking-recipe quantities found in the cook book 
examined. Thus % teaspoon was found 97 times, % cup was found 
314 times, etc. Of all quantities noted, the number one was most 
frequent, occurring 1836 times, while (me-Jialf ranks second in fre- 
quency and occurs 1127 times. The median quantity is one. 

The quantities of Table I were taken from recipes intended for 
six persons the thirty or forty other recipes in the book being 
ignored. Consequently, the arithmetical complications which arise 
in adapting the recipes for fewer or a greater number than six per- 
sons consist, for the most part, of taking %, %, %, or 1% times the 
various recipe quantities such as %, 1%, etc. Other fractional 
parts or multiples of six which might arise in adapting a given 
recipe are probably secondary in importance. 

The most striking feature of Table I is the predominance of 
small numbers. Another striking feature of the table is the great 
frequency of fractions and of mixed numbers. Very significant also 
is the fact that thirds occur as frequently as they do. They occur, 
indeed, four times as frequently as eighths, half as frequently as 
fourths, and a third as frequently as the fraction one-half. 

B. Data from factory pay rolls. Table II gives the frequency 
of occurrence of quantities in dozens found in the weekly pay rolls 

TABLE n 

QUANTITIES IN DOZENS WHICH ARE ADDED TOGETHER OR ARE MULTIPLIED 

BY INTEGERS, DECIMALS AND -MIXED NUMBERS IN RATES PER 

DOZEN IN COMPUTING THE WAGES OF PIECE WORKERS. 

(From the Pay Rolls of 10' Artificial Flower and Feather 
Factories, New York, 1916.) 
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of 100 piece workers (i. e., workers paid on tit basis of number of 
pieces or commodities made) selected at random from 300 records 
examined in ten artificial flower and feather factories, New York, 
1916. Tlie table is read: certain workers, selected at random, made 
1/12 dozen articles (at a given rate per dozen), 442 times, 1/6 
dozen articles 18 times, 1/4 dozen articles 292 times, etc. 

To compute accurately the earnings of any given worker, it 
is necessary to add to get the total number of dozens of articles made 
at each of the different rates per dozen, and then to multiply to- 
gether each given rate per dozen and the total number of dozens 
of articles made at that rate. The arithmetical processes involved 
are, therefore, addition of all possible fractions with 12 as denom- 
inator to integers and mixed numbers the fractional parts of the 
mixed numbers likewise include all possible fractions with 12 as 
denominator; multiplication by a fractional, integral, or mixed 
number of dozens, of decimals in terms of dollars and cents ; and 
addition of United States money. The following exact copy of a 
pay roll record of one piece worker for one week, will serve as an 
illustration. 



!N"o. made Bate per dozen " 

% doz. 2.25 .75 

%2 doz. 2.50 1.45 

Vz doz. 2.50 .83 

% doz. 2.50 1.25 

% doz. 2.50 2.10 

% doz. 2.50 1.25 

W doz. 2.50 .42 

1 doz. .55 .55 



8.60 



To compute accurately the total earnings of this wage earner 
for the week one proceeds as follows : 

% of $2.25ii=:$ .75. 

or 3' dozen 



$2.50, the rate per dozen, x 3, the number of dozens, =s $7.50 
$ .75+7.50+ .55=$8.80, total weekly earnings. 

The method of solution used in the office of the factory, on the 
other hand, would lead in this case to an error of one cent in the 
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total earnings. As a matter of fact, the computation of tlie factory 
office in this case is in error 20 cents 1 cent on the 7/12 dozen lot 
and 19 cents on the 11/12 dozen lot. 

The question may be asked as to why the factory worker is 
given his work in such small and odd-numbered lots. "Why, for 
example, did not the worker whose record is given above receive the 
three dozen articles all at once, or at least in even dozens instead of 
getting first 7/12 dozen, then % dozen, and so on? The explanation 
is found in the fact that the orders for goods (which commonly 
include numerous articles of different styles) coming to the manu- 
facturer are numbered as they are received and each employee, at 
any given time, is working on an article to fill a particular order. 
This method of distributing work among employees and the result- 
ing fractions with 12 as denominator were found in 29 other New 
York factories, including manufacturers of men's and women's 
hats and of men's, women's and children's clothing. The custom 
is further encouraged by the universal desire of factory hands to 
have the available work distributed equally. 

Again, the striking features of the data are the predominance 
of small numbers and of fractions and mixed numbers. The frac- 
tions found include and are limited to those having twelve or 
integral factors of twelve as denominators. The fractions one-half 
and twelfths are most common, fourths and thirds next, and sixths 
least frequent. 

C. Data from marked-down-sales advertisements. The facts 
presented in Table III reveal the nature of the arithmetical oper- 
ations with which the consumer must be familiar in order to under- 
stand the advertisements, or to compute the prices of commodities 
offered, in marked-down sales. Thei discount rates (including both 
percental and fractional forms) given in the table are the first 300 
seen by the writer and one other person, beginning with February, 
1917. Most of them were taken from one New York daily paper, 
others from store windows and delivery wagons in New York, and 
a few from newspapers outside of New York. The 300 were secured 
in approximately three months' time. They are typical for New 
York City. Because of the commercial importance of New York, 
it is probable also that further investigation will prove them typi- 
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eal for a large part of the United States. Such, evidence as the 
author has been able to get, though fragmentary, tends to show them 
to be typical for the principal cities of the Mississippi Valley and 
of the Pacific Coast. 

Table III is read thus: the rate "10 percent off" was found 
twice in advertisements of automobiles and accessories, once in ad- 
vertisements of children's clothing, four times in advertisements of 
furniture, etc. The rate "10 percent off" occurred 26 times in all. 

TABLE III 

DISTRIBUTION OF 300 DISCOUNT-KATES TAKEN FROM MARKED-DOWN-SALES 
ADVERTISEMENTS, NEW YORK, 1917. 
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Fractional Discounts 
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Total number of fractional discount rates 125 


Grand total, fractional and nercental rates 300 



The outstanding feature of Table III is that discount rates, 
with two notable exceptions, are expressed in percentages, these 
exceptions are one-Jialf and one-third. Of the 300 marked-down 
"rates noted, 70 were sales at half price. Of these 70, 57 are ex- 
pressed by the fraction % and only 13 by 50 percent. Of the 28 
sales advertising a third off, 24 express the discount by % and only 
four by 33% percent. Again, the expression "% to ^ off" occurs 
19 times while its equivalent, 33% to 50 percent, is found but four 
times. Thus, of the total number of 125 fractional discount rates 
noted, exactly 100, or 80 percent of them, are % or %. The only 
other fractional discount worth noting is %, which was noted 8 
times as a fraction and 21 times as 25 percent. The two most com- 
mon percental discounts, viz., 20 percent and 10 percent, are never 
found in fractional form. In all, 119, or 68 percent of the total 
number of 175 percental discounts noted, are in percentages which 
are not found in fractional form. On the other hand, all the 125 
fmctional discounts are sometimes found expressed in their per- 
cental equivalents. 

In general, the arithmetical operations involved in marked- 
,down sales are 10 percent, 20 percent, and 25 percent off, and % 
and % off, the regular prices of furniture, articles of clothing, dry- 
goods, notions, and house furnishings. 

D. Data from fhe general hardware catalog. Table IV sum- 
marizes the arithmetical facts found in one wholesale general hard- 
ware catalog. Thus, from the table, 1/16 inch was found four times, 
i/ 8 inch 4 times, 11/64 inch once, etc. ; 2 feet was found 6 times ; 7% 
ounces was found twice ; 1/6 dozen was given as the number of ar- 
ticles in a box, package, or carton, five times. The list price of 944 
^different articles was specified as so much per dozen, of 428 articles 
as so much per gross, etc. 
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The quantities tabulated in Table IV under units of linear 
measure appear, for the most part, as descriptive terms only, i. e., 
they are not used in arithmetical computations. They tell the linear 
dimensions of bolts, screws, nuts, tanks, etc. The retail hardware 
dealer must be able to read them and must know, what they mean. 

The quantities tabulated under units of avoirdupois weight 
are descriptive of the weights of articles. They may also be used 
in determining the shipping weight of one or more articles, and in 
this case would be added together and the sum possibly multiplied 
by a shipping rate. The weights 1 as they are, in case but one article 
was ordered, might be multiplied by the shipping rate. 

The items of greatest significance in Table IV are found under 
the headings "Number in Container " and "Price per." The fact 
that commodities are put up in boxes of a dozen or fractional part 
of a dozen, and the fact that the list price is a rate per dozen, both 
mean that computing the cost of any number of commodities less 
than a dozen would involve fractions having 12 and all the integral 
factors of 12 as denominators. For example, to find the cost of two 
articles listed at a rate per dozen, would require taking one-sixth of 
the list price. In like manner, finding the cost of five articles would 
require taking 5/12ths of the list price. 

Fractions having 12 or integral factors of 12 as denominators 
also enter into computations for finding the cost of any number of 
dozen articles less than 12 dozen, when the number of articles in a 
box or carton is one gross or when the list price is "per gross. " 
Such a case would be finding the cost of 2 dozen commodities listed 
at so much per gross l/6th of the list price would be required. 

Of significance also, although in a negative way, is the relative 
unimportance (as indicated by this catalog) of 100 as a unit in the 
hardware trade. Commodities are listed at a price per hundred 
only 22 times in a total of more than 1500 prices. 

CONCLUSIONS 

The following conclusions are subject to the limitations of the 
data on which they are based. The data do, however, furnish evi- 
dence as to some of the arithmetical activities of four groups of 
individuals. In the cases studied : 
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1. The great relative frequency of small numbers, especially 
of fractions and mixed numbers, is significant in its bearing on drill 
exercises and on tlie form of problems. 

2. It lias proved worth, while to ascertain the relative fre- 
quency of the different fractions and other number magnitudes 
which are used in the arithmetical computations of a considerable 
number of people. 

3. The prominence of the dozen as a unit of production and 
of trade suggests the importance of familiarity with the aliquot 
parts of 12. 

4. Although decimalization is one of the distinguishing fea- 
tures of present-day arithmetic, tenths and hundredths play but an 
insignificant part as units of production and of trade in com- 
modities. 

5. Discount rates advertised in marked-down sales are most 
often expressed in percents the most notable exceptions are the 
fractional forms % and % off. Discounts are practically never 
expressed as so many " cents on the dollar/' in marked-down sales 
advertisements. 

6. The method employed in this study is feasible and a part of 
the necessary procedure in the solution of the problem of what 
should constitute the course of study in arithmetic. 



CHAPTER II 

WHAT SHOULD BE THE MINIMAL INFORMATION 
ABOUT BANKING 

ALICE CAMEBEB 
University of Iowa, Iowa City, Iowa 



The primary object of this study 1 was to find out what bank 
employees think the citizens of their community ought to know 
about banking. To get this information the questionnaire that fol- 
lows was mailed to fifty employees of banks. Keplies were received 
from thirty-five persons, representing the states of Illinois, Indi- 
ana, Iowa, Kentucky, Missouri, Nebraska, North Dakota, Oregon 
and Texas. To secure still further information, the same questions 
were submitted to parents of the children in the University of Iowa 
Elementary School. 

Questionnaire 

What, from your experience, do you think the citizens of your 
community, or of any community, ought to know about the follow- 
ing items? Please state after each item. 

1. If knowledge of the item is very important put a double 
check (xx) before it. 

2. If knowledge of the item is less important, yet of some 
value, put a single check (x) before it. 

3. If knowledge of the item would be of no value, cross it out. 
In the table below the items in question are listed in order of 

their importance as finally determined by the number of double 
checks given them by the thirty-five bankers. 2 

The fourth column shows the rank assigned to each item by 
the parents, as determined in the same manner. 

*TMs study was prepared by Miss Camerer under the direction of Dr. Ernest 
Horn, of the State University of Iowa. The list of questions was originally 
drawn up by Charles B. Bounds, Superintendent of Schools, Fort Thomas, 
Kentucky, 

S 0ther methods of ranking were tried, like assigning two units to each 
double cheek and one unit to each single check, but these produced no decided 
alterations in the resulting order of importance. 
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TABLE I 

OBDEB OF IMPOBTANCE OOP VABIOTJS ITEMS OF IOTOBMATION CONNECTED WITH BANKING, 
AS BANKED BY BANK EMPLOYEES AND BY PAEENTS 



IS I 

O gH 



Item 



Very 
Important 



Number Bank Employees 
Checking as 



Somewhat 
Important 



Not 
Important 



Rank 
Order 

Assigned 
by 

Parents 



1 How to write a check 28 

2 How and why fill out the stub . . 23 

3 When check should be cashed. . 21 

4 How to stop payment of a check. 19 

5 How to sign your name when 

indorsing a check 19 

6 What to do in case a check is lost 18 

7 How to indorse a note 18 

8 How to write a negotiable note. 17 

9 How to indorse a check in full. . 16 

10 How to use a bank book 15 

11 How to maket out a deposit slip. 15 

12 How to find interest 15 

13 Importance and purpose of sav- 

ings banks 15 

14 Importance and purpose of com- 

mercial deposit banks 15 

15 How to use a promissory note. . . 14 

16 Responsibility of maker if note 

is lost 13 

17 Certified checks 13 

18 How to open an account 13 

19 When notes are void 12 

20 Legal rate of interest 12 

21 Certificate of deposit 11 

22 Purpose and us of collateral 

notes , 11 

23 How to indorse a check in blank 11 

24 How to write a non-negotiable 

note 11 

25 How to write a commercial sight 

draft 11 

26 Post dated checks 11 

27 How to indorse a check, qualified 

indorsement 11 

28 How to write a restrictive in- 

dorsement 11 

29 How to write a demand note 10 

30 How to use a commercial sight 

draft 10 

31 When notes may or do draw in- 

terest 10 

32 Howl to write a joint note 10 

33 How to write a collateral note.. 10 

34 How to write a note payable by 

installments 10 

35 How to write a joint and several 

note 10 

36 Rate of interest by contract 9 

37 How to find date of maturity of 

notes 9 

38 Purpose and value of accommo- 

dation note 9 

39 Where to pay a note 8 

40 How to secure a bank draft 8 

41 How to use a bank draft 8 



7 

11 
14 
16 

16 
16 
16 
17 
16 
18 
18 
18 

17 

17 

19 

22 

21 
20 
24 
21 
23 

21 
21 

19 

19 
17 

14 

14 

22 

22 

22 
20 
19 

19 

18 
23 

22 

15 
26 
25 
24 




1 





1 
1 
1 

3 
2 
2 
2 



3 

2 


1 
2 
1 
2 
1 

3 
3 



10 



10 

8 



11 
1 
2 
3 



3 
2 

14 
23 

6 

25 

17 

19 

8 

4 

1 

13 

15 

20 
16 

44 
29 
5 
36 
18 
12 

34 
9 

49 

31 
33 

21 

40 

38 

37 

35 
39 
45 

41 

46 
30 

26 

54 
24 
10 
11 
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TABLE I (Concluded} 



Rank Order 

Assigned by 
Bank Employees 


Item 


Number Bank Employees 
Checking as 


Rank 
Order 
Assigned 
by 
Parents 


Yery 
Important 


Somewhat 
Important 


Not 
Important 


42 
43 

44 

45 
46 

47 
48 

49 
50 
51 
52 
53 
54 
55 


Proper place on & check to mate 


8 
8 

7 
7 

7 

6 

6 
5 
5 
5 
4 
3 
2 
2 


22 
11 

26 
20 

12 
26 

20 
26 
21 
16 
16 
27 
30 
28 


5 
16 
2 

a 

14 
3 

9 
4 
9 
14 
15 
5 
3 
5 


7 
52 

32 
48 

53 
22 

47 
28 
42 
43 
55 
51 
27 
50 


Purpose of ironclad or judgment 


How to write a note payable on 


How to use a bill of exchange. . . 
How to write an ironclad or 




How to secure a bill of exchange, 


How to use travelers' checks .... 




How to write a produce note 
How to use a letter of credit. . , ., 
How to secure travelers' checks. 
How to secure a letter of credit . 



Additional Topics Suggested By Bankers 

1. Why are cheeks protested? 

2. What becomes of checks after they are protested? 

3. What Is an overdraft? 

4. What should the public know about overdrafts? 

5. How notes are discounted. 

6. Duties of bank officials. 



Of the thirty-five returns from the questionnaire, ten answered 
the first request, which was td state after each item what the cit- 
izens of a community ought to know about it. A composite of these 
ten replies follows, keeping as nearly as possible to the phraseology 
and including all points made. The number "before each item repre- 
sents the order in the questionnaire. The first number after the 
item indicates its place as shown by the bank employees, which may 
be taken as a measure of its importance from the banker's point of 
view. The second number after the item indicates its place in the 
list as shown by the parents. 
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1. Sow to open an account (18-5) 

If known, apply at receiving teller's window, give name, address, and 
deposit slip. Be prepared to name some person of whom inquiry may be made 
as to your standing and responsibility. The teller will issue you a pass book 
with amount of first deposit, give you a cheek book and take a specimen of your 
signature for the bank files. 

#. Sow to use a ~b<mk book (10-4) 

The bank book is used by some banks as a receipt for deposits only. In 
other banks it is used to record checks as well, one side being used for deposits 
and the other side for checks. The pass "book should be presented with each 
deposit and should also be balanced* at the bank occasionally if an active 
business account, once a month, unless your bank issues monthly statements. 

S f Sow to make out a deposit slip (11-1) 

Write, in places indicated, the depositor's name, the date and amount 
in currency, silver and checks. List checks separately; make total of all; 
verify sum, and present with deposit at the teller's window so that he may 
cheek. 

4. Sow to write a check (1-3) 

Mil in .with ink, number, date, name of payee and amount, in places 
indicated. The amount is recorded both in figures and writing, with the figures 
as near the dollar sign as possible and the writing very near the left end, with 
first letter a capital, and all blank spaces filled with lines 1 to avoid raising. 
TUxe written amount governs payment of check if there is any discrepancy. 
Write signature very legibly on the last line. Checks should not be given for 
less than one dollar. 

5. Sow and why fill out the stub (%-2) 

Fill out by recording the number, amount of cheek, date and name of 
payee. Subtract amount of check from total of amount brought forward, plus 
deposits since and transfer balance to next stub. This will give you a com- 
plete record of each check issued and show your present balance. 

6. Sow to indorse a check m "blank (23-9) 

Simply write the name on the back of the cheek across the left end exactly 
as it is written oix the face. If written incorrectly on the face of the cheek, 
write correctly below the incorrect indorsement. 

7. Sow to mdorse a check m full (9-8) 

A check is indorsed in full by the payee's making it payable to the order 
of some bank or individual and then, signing his name. 

8. Sow to indorse a check, Qualified indorsement (27-21) 

Qualified indorsements are not looked upon with favor, though they are 
sometimes used, as : e ' Pay to the order of John Smith when he has finished a 
certain piece of work." 

9. Sow to write a restrictive indorsement (28-40) 

The restrictive indorsement most commonly used is the one which pro- 
hibits a further negotiation of the instrument, as : { ' Pay to John Smith only. ' ' 
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10. Proper place on a check to\ m&lce an indorsement (42-7) 
The proper place for indorsement is on the back of the cheek at the left 
end, the signature written crosswise. 

11. How to sign your name when indorsing a check (5-6) 
Sign your name exactly as it is written on the face of the check,* then 
sign again with correct name, if that on the face is incorrect. 

IB. Sow to stop payment of cheek (4-83) 

The proper way to stop payment on a check is to notify the bank on 
which it is drawn, by letter, giving date of the check, number, amount; name 
of payee, whether indorsed and why payment is being stopped. 

1$. What to do m case check is lost (6-25) 

In event of loss of cheek it is possible to have payment stopped on the 
original by notifying the bank on which it is drawn, giving description o-f the 
cheek. After a reasonable time has elapsed, issue a duplicate marked so in 
red ink. 

14. Po$t-dated checks ($6-33) 

A post-dated check is one that bears some future date. The check, how- 
ever, does not become valid until its date arrives. If presented for payment 
in advance of its date, the bank cannot honor it, even though the drawer has a 
sufficient balance to his credit. Post-dated cheeks should not be issued. 

15. When a check should ~be cashed (S-14) 

A cheek should be cashed as soon as possible after it is received, the same 
day, if convenient. 

16. Certified checks (17-29) 

Certification is a promise by a bank that it will pay a certain check drawn 
upon it when presented in. the regular course with proper indorsement. A 
check is charged to maker *s account when certified. The check becomes* the 
bank's liability, and it must pay the same on presentation. Certified checks 
are used only in cases of bids on contracts and similar transactions. Certi- 
fication is mad by the bank only. 

17. Voucher checks ($0-42) 

Voucher checks are cheeks with vouchers attached, the voucher giving a 
statement of the purpose for which the check is to be used or a receipt. 

18. Certificate of deposit (81-18) 

A certificate of deposit is one issued by the bank stating that a certain 
amount of money has been deposited, payable to a certain party, either on de- 
mand or at a stated time. It is not subject to check and may draw interest. 

19. Safety deposit vaults (47-%$) 

Safety deposit vaults are fire-proof and burglar-proof, equipped with 
steel deposit boxes, each locked with two locks and opened only by operating 
both. The keys to one lock are in the possession O'f the customer, while the key 
to the other is kept by the bank. The box can be opened only by the bank and 
the customer together. These boxes are rented by the year to customers who 
may keep valuables or money therein. 
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20. Importance and purpose of savings banks (13-15) 

Savings banks fill a very important place, offering to all classes of people 
an opportunity to set aside a certain part of their income at short intervals and 
paying them interest compounded semi-annually. Deposits of savings banks 
are generally invested in real estate mortgages. 

81. Importance, and purpose of commercial deposit "banks (14-80) 

Commercial deposit banks handle deposits incident to the transaction of 
business. They facilitate exchange of credit, especially payment by check, and 
finance commercial operations. They accumulate the idle money of a com- 
munity and lend it to individuals and to business interests needing additional 
capital temporarily. 

#. Sow ta secure travelers 9 checks (54-87) 

Travelers 7 checks may be secured from banks by simply issuing your 
check for the amount of checks you desire to purchase, plus a eammission of 
y 2 percent. They may be used practically as cash, are safe means of carrying 
money, but the holder is sometimes required to furnish identification. When 
travelers' checks are issued, your signature is placed on check and is used as 
identification when you desire to cash them. 

83. Hoiv to use travelers' checks (49-28) 

They can be cashed at most hotels and railroad offices. Instructions are 
p dnted on them. 

84. How to secure a letter o\f credit (55-50) 

Letters of credit may be secured by application at any bank with a cheek 
or cash to cover value and charges. 

85. SLOW to use a letter of credit (53-51) 

A letter of credit is used by presenting at some bank or business house, 
which will honor your cheeks against the letter of credit and indorse the amount 
paid on the back of it. A letter of credit may be used in a foreign place in 
the same manner as a cheek book where the customer is known. 

86. How to secure a "bin of exchange, inland or foreign (48-47) 

Make a written application at your bank, something akin to application 
for post-office money-order, accompanied by the cash or its equivalent. 

87. How to use a "bill of exchange, Mand or foreign (45-48) 
Pollow form used in negotiating cheeks. 

88. How to\ use a promissory note (15-16) 

A negotiable promissory note is a promise made in writing by one person 
to another, signed by the maker engaging to pay on demand or at a fixed future 
time, a certain sum of money to order or bearer. When the note is drawn to 
the maker >s own order, it is not complete until indorsed by him. The bank 
will look after its collection free of charge. 

89. How to indorse a note (7-17) 

If you are guaranteeing payment at maturity or thereafter, the simple 
signing of your name will transfer title and at the same time hold you sec- 
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48. Purpose of days of grace (51-43) 

Three days are sometimes allowed the payer of a note in wMelx to pay after 
it is due. It has been abolished in most states, and others waive it. 

44. Sow to find date of maturity ($7-26) 

If the time is given in days, count exact days from the date; if in months, 
it win be due on the same date of the month of maturity as the date of the note, 
according to bankers 7 rule. The date is usually found by a maturity table. 

45. Where to pay a note (39-24) 

Most notes provide for their payment at a certain bank or office. If not 
stated in the note, it is payable at the office or residence of the payee. 

46. Responsibility of maker if note is lost (16-44) 

The maker is responsible if the note can be proved, but he may require a 
bond indemnifying Tnm against repayment. 

47. When notes are void (19-36) 

Notes are void if given by a minor, or an incompetent, if forged, obtained 
by fraud or under false pretenses. 

48. When notes may or do draw interest (31-85) 

Notes draw interest when it is so stated in the contract. A promise to 
pay with interest but without stating the rate, provides for interest at the legal 
rate. 

49. Legal rate of interest (20-18) 

State statutes govern rate of interest by providing minimal and maximal 
rates that can be lawfully charged. 

50. Eate of mterest Ky contract (36-30) 

Any rate up to and including & percent is legal in Iowa. The maximum 
prescribed by law in different states varies. 

51. How ta write a commercial sight draft (25-31) 

"At sight, or at so many days" sight, pay to the order of, and charge 
same to the account of (name). 

52. Sow to use a commercial sight draft (30-37) 

Make it payable to your bank or to yourself, indorse and handle as you 
would a check or other negotiable instrument. 

53. Sow to seowre a\ Txmh draft (40-10) 

A bank draft is 1 secured by making application at your bank and giving 
them the name of the party to whom you desire to make the draft payable, and 
the amount in cash or check to cover draft and charges. 

54. Sow to use a "bank draft (41-11) 
May be mailed in an ordinary letter and cashed just as a cheek. 

55. Sow to find interest (12-13) 

(1.) Use interest tables. (2.) Other ways: (a) Multiply amount by 
rate and time. (&) Point off two places for 60 days at 6 percent and work 
from that. (<?) Multiply sum by number of days, point! off two places, divide 
by 60 for 6 percent, by 72 for 5 percent. 
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CHAPTER III 

THE DETEEMINATION AND MEASUREMENT OF THE 

MINIMAL ESSENTIALS OF ELEMENT AEY 

SCHOOL GEOGRAPHY 



M. E. BEANOM: AND w. c. EEAVIS 

Harris Teachers College, St. Louis, Mo. 



In the few attempts that have been made to select minimal 
essentials in geography, emphasis has been placed, almost exclus- 
ively, on place geography. Minimal place material has been se- 
lected (1) through the individnal judgment of a teacher or geog- 
raphy specialist, (2) through the collective judgment of a number 
of teachers or geography specialists, (3) through a comparison of 
the relative emphasis given to certain materials in textbooks of 
geography, and (4) through a study of the frequency with which 
place names occur in newspapers and magazines. 

By the individual judgment method there will be as many lists 
of minimal essentials as there are individuals. By the collective 
judgment method, a list may be selected that will represent the 
combined judgments of the group. Since it is largely the work of 
specialists in geography to determine the content, and of adminis- 
trators to adopt methods that will insure the mastery of content, 
the judgment of a group of specialists regarding minimal essentials 
should be more nearly right than the judgment of a group of 
teachers. 

The individual judgment method was used, presumably, by Mr. 
Thompson 1 in his exercises in minimal essentials; and by Superin- 
tendent Witham 2 in establishing " A Minimum Standard for Meas- 
uring Geography" in the sixth grade, who states that he sought 

Thompson, T. E. ? Minimum Essentials in Geography. 
2 Witham, Ernest C., A minimum standard for measuring geography, Amer- 
ican School Board Journal, 50 : Jan., 1915, 13. 
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"to measure the pupils' knowledge and geographical thinking" of 
the United State with a list of fifty-five questions to be answered in 
forty-five minutes. 

The collective judgment method of specialists is illustrated 
by the work directed by Professor Whitbeck 3 in the Cornell Uni- 
versity Summer School in 1910. Professor Whitbeck believed that 
the ( scrappy' and unreliable character of the geographic knowl- 
edge of college students resulted from the superficial teaching of 
many facts, without sufficient emphasis on important facts. "With 
the aid of a class of experienced schoolmen, a minimal list of the 
cities of the world was selected, and submitted to the consideration 
of a committee of six expert geographers. All cities of the United 
States approved by at least two of the experts, and all cities of the 
rest of the world approved by at least three of the experts, were 
included in the final minimal list The results were as follows: 
25 cities' of the United States; 8 of the Western Hemisphere, ex- 
clusive of the United States ; 16 of Europe ; 8 of Asia ; 8 of Africa, 
Australia and the scattered islands. The object of this list was not 
to restrict the pupil's knowledge of other cities, but to secure 
a select group of cities of distinct value in the world of affairs, for 
which pupils might be held strictly responsible. 

The collective judgment method was also followed by a group 
of teachers of Springfield, Illinois, working under the direction of 
Professor D. C. Ridgley, 4 in 1914, with respect to the fourth and 
fifth-grade work. As a result, the following number of place names 
was recommended and adopted *f or these grades in the Springfield 
Schools: World 30, North America 27, United States 143, South 
America 35. Asia 39, Africa 19, and Australia 11. 

The textbook method applied by Dr. W. C. Bagley 5 to the con- 
tent of history could be used similarly with geography, but, in so 
far as the writers know, it has not been applied sufficiently to jus- 
tify a report. This method, however, is in effect substantially the 
same as the combined judgments of experts. 

"WMtbeck, B. H v Where shall we lay the emphasis in teaching 1 geography, 
Education, 31: Oct., 1910, 108-16. 

*Bidgley, D. C., The teaching of place geography, Journal of Geography, 
11: Sept., 1912, 13-16. 

"Bagley, W. O v The content of American history, Bull. No. 16, University 
of Illinois School of Education. 
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The last of the methods employed, that of selecting a minimal 
list of places on the basis of frequency of mention in current liter- 
ature, was reported by Dr. Bagley 6 in the Fourteenth Yearbook. 
The results of this investigation were inconclusive, but indicated 
that such a method, if taken alone, would be unsatisfactory as the 
basis for the selection of minimal essentials. 

The writers of this article hold that any list of minimal essen- 
tials in geography that does not emphasize relational facts as well as 
facts of place is inadequate. According to the modern conception o* 
geography, relations between life forms and their environments are 
important. Place geography may be taught incidentally as needed 
in a proper connection with relational geography, subsequently to 
be supplemented by special drill work if necessary. In offering a 
list of minimal essentials, the writers have attempted, therefore, 
to set up certain standards for the selection of the facts that should 
be learned, and for the relations that should be recognized and 
appreciated. 

It is conceded that the standards chosen can be justified only 
to the extent that they will permit the selection of minimal essen- 
tials that will test whether or not the aims of geography teaching 
are being realized. The aims of geography teaching are to impart 
the more important facts of conventional or practical value; to se- 
cure on the part of the pupil ability to interpret properly the geo- 
graphic factors thati enter into problems of timely moment ; and to 
develop an appreciation of the importance of the United States 
intrinsically, and its relational aspects to the world as a whole. 

The realization of these aims requires a general knowledge 
of (1) the relative location of the large land and water bodies, 

(2) the location of the more important countries of the world, 

(3) the location of the more important cities of the world, (4) 
the physical conditions of the more important countries, (5) the 
occupations of the people and the conditions of transportation, 
(6) our commercial relations with these countries, and (7) the 
fundamental relationships between the physical factors and human 
activities. 



Bagley, W. 0., The determination of miTriTnm-n essentials in elementary 
geography and history, Fourteenth Yearbook of tMs Society, Part 1, 131-147. 
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In determining a minimal essential list of countries 1 of the 
world, the following standards were employed: (1) the area of the 
country in square miles, (2) population, (3) total value of imports, 
(4) total value of imports from the United States, (5) total value 
of exports, and (6) total value of exports to the United States. 
These criteria not only offer objective data of great significance in 
the study of a particular country, but also afford a means of meas- 
uring the relationships of the United States to other countries. 

The statistical data for each of the above criteria were secured 
from the Statistical Abstract of the United States (1915) in which 
reports covering the latest year for which statistics were available, 
for the fifty-two more important countries of the world, were given. 
The countries were ranked according to their relative importance 
with respect to each of the six criteria and have been numbered 
accordingly in Table I that follows : 

The fifty-two countries of Table I were then divided into quin- 
tiles under each of the six criteria previously discussed, and values 
were assigned to rank in the various quintiles as follows : (1) rank 
in the first quintile in each criterion received a score of 5 points ; 
(2) rant in the second quintile, a score of 4 points; (3) rank in the 
third quintile, a score of 3 points; (4) rank in the fourth quintile, 
a score of 2 points; and (5) rank in the last quintile, a score of 1 
point. The total score thus received by a country would serve as 
an index of the relative importance of that country among the 
countries of the world in area, population, import and export trade j 
and of its relative importance to the United States in import and 
export trade. 

Table II indicates the total score of each country, by this 
method. These scores range from 30 points, a perfect score, in the* 
case of the United States to 6 points for Liberia, An examination " 
of the scores clearly indicates the greater importance of certain 
countries, and suggests the desirability of establishing a line of 
demarcation between the important and less important countries. 
This is exactly what the movement for economy of time in educa- 
tion seeks through a scientific determination of essentials. It 
is recognized that the placement of this line is at first a some- 
what arbitrary matter, and that through experimental evidence 



MINIMAL ESSENTIALS IN GEOGBAPHY 
TABLE I 

FIFTY-TWO COUNTRIES RANKED IN IMPORTANCE IN TEEMS OF SEE CRITERIA 





Country 


Area 


Popu- 
lation 


Total 
Imports 


Imports 
from U. S. 


Total 

Exports 


Exports 
to U. S. 


1 


United States 


4 


4 


3 


(1) 


1 


(1) 


2 


Great Britain 


29 


8 


1 




3 


3 


3 


Germany 


21 


5 


2 


2 


2 


2 


4 


France 


22 


9 


5 


5 


5 


7 


5 


India 


7 


2 


9 


22 


6 


8 


6 


Austria-Hungary 


20 


7 


8 


8 


9 


10 


7 


Russia 


1 


3 


7 


12 


7 


27 


S 


Canada 


3 


19 


11 


3 


11 


1 


9 


Italy 


32 


10 


10 


7 


10 


10 


10 


Japan 


27 


6 


15 


10 


14 


5 


11 


China 


2 


1 


13 


15 


16 


IS 


12 


Brazil 


5 


11 


21 


14 


17 


6 


13 


Argentina 


8 


20 


16 


13 


13 


11 


14 


Netherlands 


49 


24 


4 


4 


4 


9 


15 


Mexico 


9 


14 


30 


11 


23 


4 


16 


Belgium 


50 


21 


6 


6 


8 


16 


17 


Australia 


6 


31 


12 


9 


12 


21 


18 


Spain 


24 


13 


19 


16 


21 


22 


19 


Sweden 


25 


27 


17 


20 


18 


25 


20 


Egypt 


17 


15 


26 


39 


25 


19 


21 


Turkey 


12 


12 


20 


34 


27 


28 


22 


Switzerland 


48 


35 


14 


19 


15 


14 


23 


Chile 


19 


36 


28 


21 


26 


12 


24 


South Africa 


14 


23 


22 


23 


20 


38 


25 


Philippine Islands 


31 


17 


33 


17 


31 


15 


26 


Peru 


11 


26 


40 


28 


32 


18 


27 


Cuba 


15 


29 


39 


27 


38 


17 


28 


Denmark 


47 


37 


18 


18 


19 


36 


29 


Norway 


28 


41 


23 


26 


28 


26 


30 


Algeria 


18 


28 


24 


38 


29 


42 


31 


New Zealand 1 


33 


48 


27 


24 


24 


29 


32 


Persia 


13 


16 


31 


51 


35 


40 


33 


Portugal 


43 


25 


29 


25 


33 


39 


34 


Boumania 


37 


22 


25 


40 


22 


44 


35 


"Venezuela 


16 


39 


43 


30 


42 


24 


36 


Uruguay 


35 


46 


34 


36 


30 


23 


37 


Bolivia 


10 


38 


42 


41 


36 


48 


38 


Siam 


23 


18 


37 


44 


34 


46 


39 


Greece 


41 


32 


36 


45 


40 


35 


40 


Morocco 


26 


30 


32 


48 


48 


45 


41 


Serbia 


44 


34 


41 


46 


41 


41 


42 


Bulgaria 


40 


33 


35 


50 


39 


43 


43 


Bquador 


30 


44 


47 


37 


44 


32 


44 


Haiti 


51 


40 


44 


39 


43 


50 


45 


Tunis 


36 


43 


38 


43 


37 


49 


46 


Honduras 


39 


50 


49 


32 


50 


33 


47 


Costa Rica 


46 


51 


48 


35 


47 


30 


48 


Guatemala 


88 


42 


45 


33 


45 


31 


49 


Panama 


45 


52 


46 


31 


51 


37 


50 


Salvador 


52 


47 


51 


42 


46 


34 


51 


Paraguay 


34 


39 


50 


47 


49 


47 


52 


Liberia 


42 


45 


52 


49 


52 


51 
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TABLE H 

POINTS SCORED BY FIFTY-TWO COUNTRIES IN SIX CRITERIA OF 

IMPORTANCE 



Country Area 


Total 
Pop. Imports 


Imports 
from U. S. 


Total 
Exports 


Exports 
to U. S. 


*TotaI 


1 


United States 


5 


5 


5 


(5) 


5 


(5) 


sir 


2 


Great Britain 


3 


5 


5 


5 


5 


5 


28 


3 

4 


Germany 
France 


3 
3 


5 
5 


5 
5 


5 
5 


5 
5 


5 
5 


28 
28 


5 


India 


5 


5 


5 


3 


5 


5 


28 


6 
7 


Austria-Hungary 
Russia 


4 
5 


5 
5 


5 
5 


5 
4 


5 
5 


4 
3 


28 
27 


8 


Canada 


5 


4 


4 


5 


4 


5 


27 


9 


Italy 


2 


5 


5 


5 


5 


5 


27 


10 
11 


_ * 
Japan 
China 


3 

5 


5 
5 


4 
4 


5 

4 


4 
4 


5 
4 


26 
26 


12 


Brazil 


5 


4 


3 


4 


4 


5 


25 


13 
14 


Argentina 
Netherlands 


5 
1 


4 
3 


4 
5 


4 
5 


4 
5 


4 
5 


25 
24 


15 


Mexico 


5 


4 


3 


4 


3 


5 


24 


16 


Belgium 


1 


3 


5 


5 


5 


4 


28 


17 


Australia 


6 


2 


4 


5 


4 


3 


23 


18 


Spain 


3 


4 


4 


4 


3 


8 


21 


19 


Sweden 


3 


3 


4 


4 


4 


8 


21 


20 


Egypt 


4 


4 


3 


2 


8 


4 


20 


21 


Turkey 


4 


4 


3 


2 


3 


4 


20 


22 


Switzerland 


1 


2 


4 


4 


4 


4 


19 


23 


Chile 


4 


2 


3 


3 


3 


4 


19 


24 


South African Union 


4 


3 


3 


3 


4 


2 


19 


25 
26 


Philippine Islands 
Peru 


2 
4 


4 
3 


2 
2 


4 
3 


2 
2 


4 
4 


18 
18 


27 


Cuba 


4 


3 


1 


3 


2 


4 


17 


28 


Denmark 


1 


2 


4 


4 


4 


2 


17 


29 


Norway 


3 


2 


3 


3 


3 


3 


17 


30 


Algeria 


4 


3 


3 


2 


3 


1 


16 


31 


New Zealand 


2 


1 


3 


3 


3 


8 


15 


32 


Persia 


4 


4 . 


2 


1 


2 


2 


15 


33 


Portugal 


1 


3 


8 


3 


2 


2 


14 


34 


Roumania 


2 


3 


3 


2 


3 


1 


14 


35 


Venezuela 


4 


2 


1 


3 


1 


8 


14 


36 


Bolivia 


5 


2 


1 


2 


2 


1 


18 


37 


" Uruguay 


2 


1 


2 


> 2 


3 


8 


13 


38 


Siam 


3 


4 


2 


1 


9* 


1 


18 


39 


Greece 


2 


2 


2 


1 


3J 


2 


11 


40 


Morocco 


3 


3 


2 


1 


1 


1 


11 


41 


Serbia 


1 


2 


2 


1 


2 


2 


10 


42 


Bulgaria 


2 


2 


2 


1 


2 


1 


10 


43 


Equador 


3 


1 


1 


2 


1 


2 


10 


44 


Haiti 


1 


2 


1 


3 


1 


1 


9 


45 


Tunis 


2 


1 


2 


1 


2 


1 


9 


46 


Honduras 


2 


1 


1 


2 


1 


1 


9 


47 


Costa Rica 


1 


1 


1 


2 


1 


8 


9 


48 


Guatemala 


2 


1 


1 


2 


1 


2 


9 


49 


Panama 


1 


1 


1 


2 


1 


2 


8 


50 


Salvador 


1 


1 


1 , 


1 


1 


2 


7 


51 


Paraguay 


2 


1 


1 


1 


1 


1 


7 


52 


Liberia 


1 


1 


1 


1 


1 


1 


6 



*Nota: An arbitrary perfect score of thirty points has been assigned to the 
United States because it is the home country of the pupils. 
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or radical changes in statistical data, some readjustment may be 
desirable. However, tlie score of 20 points, tlie lower limit of 
the second quintile, seems to offer the most satisfactory place for 
a tentative limiting line for minimal essentials. This places twenty- 
one countries in the ' ' minimal essential list. ' ' These should receive 
a more comprehensive treatment than would be given to the re- 
maining thirty-one countries. 

In the selection of a minimal list of cities, several factors such 
as import and export trade, advantages of location, importance of 
hinterland, and advantages of transportation, were tried as stan- 
dards ; but the lack of sufficient data for many cities rendered such 
work unsatisfactory. A very close correlation, however, was found 
to obtain between these standards in cases where such data were 
available and the single standard of population. It was decided, 
therefore, to use the standard of population as a criterion for de- 
termining the list of cities. After considering the list of cities de- 
termined by the single standard of population, it was believed that 
the largest city of each of the 21 i essential' countries of the world 
(as previously determined) should be included in the list, with the 
addition of all other cities of more than 200,000 population in the 
Western Hemisphere, of all other cities of more than 600,000 popu- 
lation in Europe, and of all other cities of more than 800,000 popu- 
lation in the rest of the world. This standard of population was 
established on the basis of American relations to the different reg- 
ions of the world. 

This gives a list 7 of 29 cities for the United States ; 10 for the 
Western Hemisphere, exclusive of the United States ; 18 for Europe; 
and 9 for Asia, Africa, Australia, and the scattered islands. All 
of these are located in the more important countries, and the pupil 
will have an opportunity to express judgment on them (excepting 
Havana, Montevideo, and Santiago) in the completion test that 
follows. 

In selecting a minimal list of products, dependence has been 
placed upon the value of production in the United States, supple- 
mented by the value of products imported into the United States. 
The aggregate value of a class of products may be large with large 

7 See f or complete list of cities the completion test that follows. 
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quantities in use, and a low price ; or with, small quantities in use, 
and a high price. Neither price nor quantity is an exclusive index 
of the importance of the products to man. Ranking products in 
order of aggregate values has the advantage of taking both these 
factors into consideration. 

Banking the products on the basis of the aggregate values of 
each, product for all countries is desirable, but, because of unsatis- 
factory data, impracticable. Fortunately, from a somewhat differ- 
ent point of view statistics almost as satisfactory can be obtained. 
Eecent world events have brought out in an emphatic manner the 
commercial dependence of every first-class power upon practically 
every part of the earth. The United States, consequently, either 
produces practically all important materials or imports them in 
important quantities from other producing areas. Hence, a con- 
sideration of the products of the United States and the products 
imported into the United States offers a comprehensive list of the 
world's industrial products. 

Only the more significant of these products should be included 
in the minimal essential list. 8 It has been assumed that all plant, 
animal, and mineral products with a production value in the United 
States of $5,000,000 or more, annually, should be considered; and 
that this list should be supplemented by all products, not otherwise 
included, imported in quantities valued at $5,000,000 annually. 

Irrespective of values, however, materials of general distribu- 
tion, such as hay, clay, sand, and stone, or materials, such as mush- 
rooms, for which information concerning distribution is inadequate, 
have been omitted. 

In working out the relational material, it has been assumed that 
location, area, surface features, soils, climate, distribution of plant 
and animal forms, and distribution of minerals are the significant 
physical factors. ,The pupil's knowledge of geography, however, 
has not been tested sufficiently unless he has shown his appreciation 
of the ways these factors have influenced man, and unless he shows 
Ms ability to select important factors that enter into a geographic 
problem. We recognize the difficulties involved in testing rela- 
tional geography, and the relative simplicity of testing place geog- 



this list of products see Part III of the completion test that follows. 
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raphy. Tlie mere testing of place knowledge, however, reveals a 
very limited amount of tlie modern geographic knowledge demanded 
of a pupil. As a matter of fact, place geography may be taught 
solely by means of drills ; or it may be taught incidentally in con- 
nection with the solution of geographic problems. The place tests, 
since they do not indicate whether relations were developed, or 
merely taken for granted, manifestly do not measure the most vital 
part of geography. 

After this body of minimal material has been taught with suf- 
ficient and satisfactory emphasis, a measure of the results can be 
made by the use of the following completion test. It should be 
noted in this connection that Part III may be adapted to any areal 
unit, whether political or geographic, but with slight modification. 
It is hoped, therefore, that the test will prove helpful to those who 
may wish to test a geographic province or a part of a country, as 
well as to those who desire to apply it to political units only. It 
is not intended that any group of pupils needs to react to all of the 
twenty-one important countries, along the lines indicated in this 
part of the test. It is suggested, however, that the test be given 
for at least three of the major countries, and that the results thus 
obtained be averaged and regarded as an index of the pupil's 
knowledge in general of other countries. 

COMPLETION TEST FOR THE MEASUREMENT OF MINIMAL GEOGRAPHIC 
KNOWLEDGE OF ELEMENTARY SCHOOL CHILDREN 9 

Pupil Age. . . . Grade School 



! PART I 

On a 9x12 unlettered outline map of the world, indicate the 
location of the continents and oceans by writing the names in the 
proper places. .Time limit, 3 minutes. Allow % point for each 
continent or ocean correctly located. Possible score, 5.5 points. 

PARTII 

On a 9x12 unlettered outline map of the world, write in the 
correct place the name of each of the following countries : United 



the values of the several exercises, see the score card that follows. In 
case of doubt regarding correctness of the pupil's response to an exercise, it is 
recommended that he be given the benefit of the doubt. 
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States, Great Britian, Germany, France, India, Italy, Bussia, Can- 
ada, Austria-Hungary, Japan, China, Brazil, Argentina, Nether- 
lands, Mexico, Belgium, Australia, Spain, Sweden, Egypt, Turkey. 
Time limit, 5 minutes. Allow ^ point for each country located 
correctly. Possible score, 10.5 points. 

PART in , 

Country 

1. Give the direction of this country from your home city 



2. Give in square miles the approximate area of the United 
States Underline the term that more nearly ex- 
presses the area of the above-named country 10 in comparison with 
the United States : Larger Smaller Approximately the same. 

3. Give the approximate population of the United States 

Underline the term that more nearly expresses the 

population of the above country 10 in comparison with the United 
States : Larger Smaller Approximately the same. 

4. Name an important highland of this country 

5. Underline the statements that more nearly indicate the 
prevailing conditions of this highland : 

Easy to cross Dense population No large cities 

Extends above tree Permanent snowfields Herding industry im- 

line Much mining portant 

Large cities Difficult to cross 

6. Name an important river basin of this country 



7. Underline the statements that more nearly indicate the 
prevailing conditions concerning this lowland. 

Dense population Much mining Manufacturing im- 

Eiver important for Much swamp and ov- portant 

navigation erflow land Sparse population 

Irrigation practiced Agriculture import- Herding important 

ant 
a 0mit in testing knowledge of the United States. 



MINIMAL ESSENTIALS IN GEOGRAPHY 37 

8. Underline the statement that describes the prevailing tem- 
perature of the country : Primarily in hot belt Primarily in cold 
belt Primarily in intermediate belt. 

9. Underline the statement that describes the prevailing rain- 
fall: Heavy rainfall (Above 50 in.) Moderate rainfall (20 to 
50 in.) Light rainfall (Less than 20 in.) 

10. Underline the name of each plant product that is import- 
ant in this country : 

Corn Cotton Peaches Lemons 

Wheat Tobacco Peas Fibres 

Oats Flax Silk Eubber 

Barley Eice Cocoa Bananas 

Eye Sugar Coffee Grapes 

Buckwheat Apples Tea Nuts 

Potatoes Beans Oranges Wood 

11. Write the name of one of the products underlined above 
Underline its important use or uses : 

Food for man Clothing Luxury 

Fuel Shelter Food for animals 

12. Underline the name of each animal that is important in 
this country: cattle hogs sheep horses mules goats poultry 

13. Write the name of one of the classes of animals under- 
lined above Underline its important 

use or uses : 

Meat Milk Clothing Eggs Beast of burden 

14. Underline the name of each mineral product that is im- 
portant in this country : 

Coal Nickel Natural gas Lead 

Iron Copper Tin Zinc 

Petroleum Gold Silver Aluminum 

Phosphates Sulphur 

15. Write the name of one mineral product underlined above 
Underline its important uses or use : 

Fuel Alloy Paints 

Machinery Light Plumbing supplies 

Fertilizer Jewelry Chemicals 
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16. Underline the prevailing manufacturing conditions : 
Extensive Moderate Slight 

17. Underline the influential factors in the development of 
manufacturing : 



Scarcity of coal 
Abundant capital 
Little water power 



Insufficient labor 

supply 
Scarcity of capital 



Good water power 
Much coal 
Abundant labor 
supply 

18. Underline statements that properly describe the prevail- 
ing conditions of transportation: 

Elvers important Railroads well de- Public roads well 

Rivers of little im- veloped 

portance Railroads undevel- 

Lakes very important oped 

Lakes of little im- 
portance 



improved 

Public roads in bad 
condition 



19. Underline. each of the cities of this country: 



Washington 


Boston 


Philadelphia 


Toronto 


London 


Buffalo 


Pittsburgh 


Budapest 


Berlin 


Chicago 


Portland 


Glasgow 


Paris 


Cincinnati 


Providence 


Hamburg 


Petrograd 


Cleveland 


Rochester 


Liverpool 


Vienna 


Columbus 


St. Louis 


Manchester 


Tokyo 


Denver 


St. Paul 


Moscow 


Rio de Janeiro 


Detroit 


San Francisco 


Naples 


Buenos Aires 


Indianapolis 


Seattle 


"Warsaw 


Mexico City 


Jersey City 


New York 


Bombay 


Brussels 


Kansas City 


Bahia 


Canton 


Sydney 


Los Angeles 


Havana 


Hankow 


Madrid 


Louisville 


Montevideo 


Osaka 


Stockholm 


Milwaukee 


Montreal 


Tientsin 


Cairo 


Minneapolis 


Santiago 


Calcutta 


Constantinople 


Newark 


Sao Paulo 


Amsterdam 


Baltimore 


New Orleans 
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20. "Write the name of one of the cities underlined in the pre- 
ceding exercise Underline the statements that 

properly describe tMs city : 

Seaport Important railroad An important mann- 

River port center factoring center 

L/ake port A political capital An important com- 

A motmtain pass city mereial center 

Time limit 30 minutes. 



Pupil. 



SCORE CARD 

. Age .... Grade . 



School. 



Part I 


Partn 


Part III 


Country 


Country 


Country 


to : : 

No. 


!i 

P1402 


-T3 

o 

ll 

o < 
P4Q 


No. 


1* 

M f-> 

S8 

P40Q 


13 

ll 

PMQ 


No. 


s 

11 

PHOQ 


ii 

PL,Q 


"S 

<o> o 

&m 


^3 

.| 
ll 

PMP 


o 

II 

PkoQ 


TS 

ii 



P*Q 


1 
2 
3 
4 
5 
6 
7 
8 
9 
10 
11 


% 
% 

* 

% 
% 
% 
% 

1 




1 
2 
3 
4 
5 
6 
7 
8 
9 
10 
11 
12 
13 
14, 
15 
16 
17 
18 
19 
20 
21 


% 
% 
% 
% 



% 
% 

% 
% 



ru. 




1 
2 
3 
4 
5 
6 
7 

9 
10 
11 
12 
13 
14 
15 
16 
17 
18 
19 
20 


1 
4 
4 
2 
4 
2 
4 
4 
4 
4 
5 
4 
5 
4 
5 
4 
5 
5 
7 
7 




1 
4 
4 




1 

4 

4 




















2 




2 

4 
2 
4 
4 

4 










2 

4 

4 










































4 
4 
5 














4 
5 
4 




Tot a 






5 

4 




5 
4 
5 
4 
5 








4 










5 
5 

7 

7 












5 










7 










7 




Total 





Note: If more than one country is tested under Part HI, add tlie total points 
deducted and find the average, which is to be regarded as the total points to be deducted 
lor Part III. 



Possible Score 

Total Points Deducted Pt. I. 
Total Points Deducted Pt. II. 
Total Points Deducted Pt. III. 
TOTAL POINTS DEDUCTED. 
Pupil's Score - - - 



.100 



CHAPTER IV 

ANALYSIS OF THE VOCABUL ABIES OF TEN 
SECOND-YEAB BEADEES 



E. T. HOUSH 
Superintendent of Schools, Carrol, Iowa 



PURPOSE 

The general purpose of this study is to determine scientifically 
the vocabulary of ten Second Beaders in common use in the Amer- 
ican elementary schools. 

The popular notion that one series of readers is superior to 
another is based largely upon a feeling of like for, or dislike of, one 
or the other series, and not upon a basis of scientific comparison. 

At present readers are selected upon a basis of ' general merit, ' 
but 'general merit' is a loose and undefined term. To some, who 
are primarily interested in the quality of illustrations, the 
content is not so important ; others are interested in the mechanical 
make-up ; while others view the reading problem frotm the literary 
point of view only, overlooking the other qualities. 

This study represents an attempt to find a basis for measuring 
the quality of readers in so far as the vocabulary of these readers 
is a factdr in determining their worth. The study (1) determines 
the entire vocabulary of each of the ten readers, (2) determines 
their common vocabulary, (3) compares the vocabularies of the 
'method' and 'content' readers, and (4) shows by means of the 
vocabularies the relations between these two kinds of readers. 

MATEEIAL 

The materials for the Investigation are ten second-year readers 
from widely known series. The selection of readers was made with 
no idea of using the ten best series or even the ten most extensively 
used in the state of Iowa. The list was taken, excepting in two or 

40 
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three instances, from Superintendent Jones' study covering the 
United States, and represents the highest frequencies in the country 
as a whole. 

The list includes three ' method' readers namely, the Rational 
Method in Reading by "Ward (1899 ed.) , the Aldine Second Reader 
(1907 ed.) 3 the Beacon Second Reader (1914 ed.), and seven 'eon- 
tent 7 readers, namely, the Riverside Second Reader (1911 ed.), the 
Elson Primary ScTtioiol Reader, Book II (1913 ed.), the Cyr Reader, 
Book II (1901 ed.), the New Education Reader, Book II (1900 ed.), 
the Baldwin and Bender Reader (1911 ed.), the Heafh Second 
Redder (1903 ed.), and the Gordon, Reader, Second Book (1910 ed.). 

METHOD 

.The words of each of the ten readers were first counted, page 
by page, and each word listed, together with the nnmber of times 
it occurred on the page. From this page list the vocabulary of 
each book was tabulated in a combination of an alphabetical and 
group system, together with the frequency of recurrence of each 
word in the entire book. From these vocabularies a tabulation was 
then made showing the entire vocabulary of the ten books arranged 
in the same order as the separate vocabularies, and containing the 
word-frequencies, as shown later. 

The ten readers together comprised 1566 pages, with a total 
of 143,789 words. Minor errors in counting may have occurred, 
but could not have greatly influenced the totals. 

RESULTS 

Below is given the vocabulary that is common to the ten second 
readers included in this study, together with the frequencies of 
each word that appeared 14 times or more. Throughout the study, 
every difference in spelling is counted as a new word. 

923 

901 
890 
883 
822 
804 
802 



the 


10429 


you 


1866 


they 


1199 


on 


and 


4631 


it 


1737 


the 


1190 


so 


to 


3896 


of 


1616 


that 


1170 


at 


a 


3818 


is 


1593 


Ms 


1073 


her 


I 


2888 


said 


1344 


not 


1068 


me 


lie 


2346 


little 


1430 


for 


1025 


all 


in 


1997 


was 


1224 


will 


952 


then 
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but 

are 

my 

one 

do 

be 

had 

with 

have 

what 

Mm 

tliem 

see 

tliere 

go 

up 

very 

when 

we 

no 

out 

eome 

this 

day 

can 

did 

mother 

away 

old 

were 

your 

how 

now 

some 

from 

into 

could 

would 

boy 

down 

if 

by 

oh 

came 

who 

tree 

big 

am 

like 

their 

good 

get 

time 



786 


has 


284 


111 


163 


head 


113 


767 


saw 


273 


looked 


163 


birds - 


111 


766 


make 


269 


off 


161 


fine 


111 


737 


know 


266 


money 


160 


heard 


111 


696 


house 


262 


morning 


160 


under 


110 


691 


long 


261 


door 


159 


does 


109 


684 


must 


260 


cat 


154 


stiU 


109 


678 


made 


257 


dog 


154 


baby 


107 


675 


let 


254 


find 


153 


fly 


107 


623 


ran 


251 


an 


153 


ME 


107 


613 


think 


250 


help 


151 


song 


106 


607 


about 


237 


red 


151 


any 


104 


606 


man 


237 


two 


151 


warm 


104 


598 


look 


236 


asked 


149 


always 


103 


589 


take 


232 


only 


149 


around 


103 


565 
561 


pretty 
went 


228 
225 


girl 
say 


149 
146 


caEed 
child 


103 
103 


537 


here 


223 


want 


146 


sleep 


103 


531 


too 


222 


flowers 


143 


should 


102 


514 


where 


220 


last 


143 


told 


102 


490 


well 


217 


upon 


141 


boys 


101 


483 


DUt 


215 


or 


140 


ever 


101 


478 


Jtr v 

give 


212 


three 


140 


through 


101 


471 


may 


211 


yes 


140 


afraid 


100 


461 


tell 


211 


father 


139 


please 


100 


460 


over 


210 


leaves 


139 


things 


98 


454 


just 


209 


run 


136 


ground 


97 


426 


never 


209 


other 


135 


sky 


97 


426 


back 


208 


hear 


134 


while 


97 


426 


many 


203' 


fave 


132 


right 


96 


419 


again 


201 


on't 


131 


voice 


96 


415 


water 


201 


sing 


131 


bright 


95 


413 


why 


200 


kind 


130 


better 


94 


387 


us 


199 


been 


128 


flew 


94 


384 


shall 


198 


before 


128 


live 


94 


366 


each 


193 


keep 


128 


love 


94 


365 


happy 


186 


eyes 


126 


wish 


94 


356 


thought 


186 


found 


126 


fast 


93 


354 


wMte 


'186 


began 


125 


himself 


93 


343 


hen 


183 


first 


122 


place 


93 


343 


dear 


182 


lived 


122 


sweet 


93 


342 


its 


180 


night 


122 


until 


93 


340 


our 


180 


beautiful 


121 


which 


93 


328 


eat 


179 


these 


121 


bear 


92 


323 


soon 


179 


thou 


121 


spring 


92 


306 


children 


178 


much 


120 


glad 


90 


303 


more 


168 


cried 


119 


strong 


90 


301 


going 


167 


after 


118 


hand 


89 


300 


every 


166 


another 


118 


near 


89 


300 


plan 


166 


brook 


118 


brother 


88 


299 


poor 


166 


nest 


118 


says 


88 


294 


bird 


164 


sun 


118 


work 


88 


293 


great 


164 


took 


115 


best 


87 


287 


wind 


164 


fire 


113 


sometimes 


86 
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call 


85 


horse 


85 


fish 


84 


cold 


83 


nice 


83 


something 


83 


till 


83 


bring 


81 


shoes 


80 


woman 


80 


name 


79 


grow 


79 


small 


79 


sat 


78 


wise 


78 


yellow 


78 


black 


77 


far 


77 


looking 


77 


open 


77 


snow 


77 


woods 


77 


got 


76 


grass 


76 


high 


76 


winter 


76 


coming 


75 


feet 


75 


fell 


75 


gold 


75 


jump 


74 


gone 


73 


room 


73 


seen 


71 


behind 


70 


blue 


70 


might 


70 


rose 


70 


hard 


69 


wanted 


69 


fall 


68 


nothing 


68 


river 


68 



soft 

food 

full 

together 

corn 

lay 

catch 

field 

done 

round 

such 

thank 

new 

dark 

bread 

large 

rest 



barn 

but 

dress 



town 

air 

cannot 

goes 

talk 

green 

light 

set 

stop 

brought 

hay 

care 

summer 

to-day 

try 

walk 

brought 

face 

hold 

watch 

basket 



68 


carry 


52 


sad 


40 


67 


indeed 


52 


kept 


40 


67 


angry 


51 


cross 


39 


67 


clear 


51 


often 


39 


66 


stock 


51 


threw 


39 


66 


book 


50 


anything 


38 


65 


wings 


50 


pleased 


38 


65 


garden 


49 


heart 


38 


63 


stay 


49 


nor 


37 


63 


stop 


49 


shine 


37 


63 


window 


49 


wide 


37 


63 


guess 


48 


word 


37 


62 


oak 


48 


earth 


36 


60 


picked 


48 


felt 


36 


59 


fat 


47 


follow 


36 


59 


jumped 


47 


years 


36 


59 


named 


47 


rain 


35 


58 


ready 


46 


deep 


34 


58 


everything 


45 


mind 


34 


58 


joy 


45 


soft 


34 


58 


met 


45 


golden 


33 


58 


own 


45 


learn 


33 


58 


show 


45 


stand 


33 


57 


use 


45 


gentle 


32 


57 


across 


44 


sent 


32 


57 


alone 


44 


true 


32 


57 


bad 


44 


sell 


31 


56 


brown 


44 


winning 


30 


56 


fun 


44 


sail 


30 


56 


hole 


44 


forget 


29 


56 


leaf 


44 


then 


29 


55 


ride 


44 


neck 


28 


55 


almost 


43 


beside 


27 


54 


lady 


43 


yourself 


27 


54 


eating 


43 


PUP 


26 


54 


set 


42 


six 


25 


54 


side 


42 


crept 


24 


54 


those 


42 


mine 


24 


53 


among 


41 


feel 


23 


53 


hat 


41 


hope 


22 


53 


need 


41 


ten 


20 


53 


running 


41 


middle 


18 


52 


top 


41 


lame 


14 



A large percentage of these words occurs but one, two or three 
times in any single reader, as is made clear in the tables which fol- 
low. This seems to afford too little provision for drill and review. 
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TABLE II 

NUMBER OF WORDS OCCURRING 1, 2 AND 3 TIMES, BY BEADEBS 

Number of times Elson Ward B & B Aldine New Ed. Gordon River- Cyr Heath Beacon 
occTirrmsr side 



1 


641 


826 


472 


578 


650 


592 


438 


637 


437 


318 


2 


263 


329 


302 


344 


250 


259 


213 


238 


263 


341 


3 


187 


147 


166 


161 


153 


134 


128 


111 


107 


138 



TABLE III 
PERCENTAGE OF WOEDS OCCTJBBING 1, 2 AND 3 TIMES BY BEADEBS. 

Number of times Elson Ward B & B Aldine New Ed. Gordon River- Cyr Heath Beacon 

occurring side 

1 33 56 4347 30.74 34.12 39.20 42.68 30.08 37.06 34.03 21.66 

2 13 77 17.31 19.67 20.31 15.08 18.67 14.62 19.86 20.48 23.23 
3 9.97 7.74 10.81 9.50 9.23 9.73 8.78 9.26 8.33 9.40 

The three following percentage tables show the number of 
words in the vocabularies of all of the ten books, the common vo- 
cabularies of these books, the number of new words in the content 
readers as compared with the method readers, the ratio of common 
words to the new words expressed in percents, and the percentage 
of words found in each of the books as compared with the vocab- 
ulary of the selected basic text. 

"When children have completed their basic text, the question 
of supplementary reading material must be raised. The writer 
has found a wide divergence of opinion upon this subject, but so 
far has not been able to discover any authoritative conclusions as 
to what should constitute the basis of selection. Opinions as to the 
proper number of new words in a supplementary reader vary from 
those that advocate the greatest number of new words possible for 
a reader to those at the other extreme, who advocate the smallest 
number possible. It has also occurred to some to strike a happy 
medium between these two extreme positions. It seems possible 

TABLE IV 

A METHOD BEADEB (WARD) OOMPABED WITH THE SEVEN" CONTENT BEADEBS 3FOB THE 
PUBPOSE Off SUGGESTING SUPPLEMENTARY MATEBIAL 

Ward Cyr Heath Gordon B &B River- NewBdl Bison 

side 



Total number of 
















different words 


1900 1198 


1248 


1387 


1535 


1457 


1658 


1910 


Number of words 
















common to all ten 
















readers 


419 419 


419 


419 


419 


419 


419 


419 


Number of" words 
















not found in Ward 


518 


589 


611 


657 


678 


934 


972 


Number of words 
















found in Ward 


680 


695 


776 


878 


779 


724 


928 
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that cMldren cannot learn to read fluently if continually hampered 
by new word f orms. It seems evident also that a reader with too 
small a number of new words would not be the most desirable as 
a supplementary text. 

TABLE v 

A SECOND METHOD BEADEB ( ALDINE ) COMPARED WITH THE SEVEK CONTENT BEADEBS POB 
THE PTTBPOSE OP SUGGESTING SUPPLEMENTABY MATERIAL 





Aldine Cyr 


Heath 


Gordon 


River- 
side 


B&B 


New Ed. 


Elson 


Total number of 
















different words 


1694 1198 


1248 


1387 


1457 


1535 


1685 


1910 


Number of words 
















common to all ten 
















readers 


419 419 


419 


419 


419 


419 


419 


419 


Number of words 
















not found in Aldine 


521 


603 


631 


646 


677 


908 


996 


Number of words 
















found in Aldine 


677 


681 


756 


811 


858 


750 


914 



TABLE VI 

A THIBD METHOD BEADEB (BEACON) COMPARED WITH SEVEN CONTENT BEADEBS FOB THE 
PXTBPOSE Off SUGGESTING SftTPPLEMENTABY MATEBIAL 



Beacon Oyr 


Heath 


Gordon 


River- 
side 


B&B 


New Ed. 


Elson 


Total number of 
different words 
Number of words 
common to all 
Number of words 
not found in Beacon 
Number of words 
found in Beacon 


1468 1198 
419 419 
543 
655 


1284 
419 
571 
713 


1378 
419 
692 
695 


1457 
419 
749 
708 


1535 
419 
782 
753 


1658 
419 
986 
672 


1910 
419 
1066 
844 



CONCLUSIONS 

1. A critical analysis of the vocabularies of a series of readers 
seems to give a measure of their value. 

2. Such an analysis will aid in selecting supplementary read- 
ers for use in connection with a given basic text. 

3. The readers present in the second grade quite different 
lists of words. Of the thousands of words in the ten readers, only 
419 are common to all ten, while when a 'method* reader and a 
i content 5 reader are compared, the number of words common to the 
two books is still relatively small, ranging only from 655 to 928 
words. 

4. Hundreds of the words used in each reader occur only once, 
twice or thrice in that reader, thus failing to develop drill on these 
words. 



CHAPTER Y 

COMPOSITION STANDAEDS IN THE ELEMENTARY 
SCHOOL, ARRANGED TO SHOW THE MIN- 
IMAL PERFORMANCE ESSENTIAL 
IN GRADES TWO TO EIGHT 



JAMES FLEMING- HOSIC 
Head of the Department of English, Chicago Normal College 



Abont two years ago the teachers of the Parker Practice School, 
which is one of the elementary schools connected with the Chicago 
Normal College, agreed to undertake to select compositions for each 
of the grades from the second to the eighth which should serve the 
purpose of standards of attainment for those grades. It was agreed 
that the type of compositions should "be written narrative from ex- 
perience, this "being the easiest, most popular, and most natural 
type of writing for children in the grades. If the work proved 
successful, it was hoped that other types might be standardized in 
like manner. 

Each child was permitted to select his own subject. The pa- 
pers were written in school during a regular school period with no 
help from the teacher. 

From the papers written by each class the teacher in charge 
chose ten, classified as follows: two regarded as excellent, graded 
E; two good in thought and good in form graded G. G.; two, good in 
thought and poor in form, graded \G. P.; two, poor in thought and 
good in form, graded P. G.; and two, fair or passing, graded F. 
No marks were placed on the papers, however, by the room teacher. 

Committees for choosing the final standards were formed by 
grouping all of the teachers from three grades to select the standards 
for the middle grade of the three represented. For example, the 
standards for the fourth grade were selected by a committee com- 
posed of all the teachers of the third, fourth, and fifth grades. 
The object of this was to secure a certain uniformity of judgment 

46 
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by planning so that a majority of the same persons should engage 
in the task of judging the work of two consecutive grades. 

"When the committees came to consider the collection of papers 
that were marked excellent, the number of which from each grade 
varied from six to ten, it was found advisable to make another 
grouping not asked for in the original plan. This group was desig- 
nated superior, and graded S. It comprised themes that showed 
something more in the handling of material than the average E 
paper. These superior compositions were included in the scale to 
show what wiU be done by exceptional pupils or by ordinary pupils 
in exceptional circumstances. It is a matter of regret that the 
committee did not see fit to include compositions representing the 
lower degrees of performance as well. It was not the intention, 
however, to produce a composition scale in the strict sense, but 
merely a collection of compositions which should serve the purpose 
of establishing standards of relative exactness for each of the 
grades. In actual use it was thought that compositions not so good 
as the passing compositions of the standards would simply be 
marked 'poor' without attempt to establish their actual merit. 

About thirty papers from each grade were marked by each 
member of the committee appointed to select the standard of that 
grade. These compositions with their marks 1 were then turned over 
to a reviewing committee, composed of Elizabeth Blish, CJtairman, 
Mary Bonfield, Lillian G-. Baldwin, Sadie Phillips, Emma B. Lowell, 
and May L. Edwards, who read the papers, considered the marks, 
and finally selected in conference one typical example to represent 
each mark. In this way a series of five or six compositions was 
chosen for each grade of the elementary school, beginning with the 
second, as will be seen by reference to the specimens which follow. 
The members of the reviewing committee felt that the fair, or just 
passing, papers were more satisfactory as standards than any of the 
others. The progress from grade to grade in the case of these papers 
seemed gradual. The superior and the excellent papers, however, 
presented a much wider range of excellence, which seemed to be due 
to unusual children, or possibly to unusual experiences of some chil- 
dren. It was fairly clear that some of the superior compositions 
were due to the extraordinary circumstances through which the 
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child had passed, rather than to any extraordinary ability on his 
part. So far as the standards have been tested in classes of students 
considering the subject of teaching English, it appears that there is 
a fairly gradnal progress from Grade II to Grade VI. Above this, 
however, those who have attempted to evaluate the standards have 
had difficulty. It is doubtful whether there is any clear progress 
above the sixth grade. If this should prove to be the case, it 
would be one additional argument for the reorganization of the 
English work of the seventh and eighth grades. 

It will be noted that the committee of teachers made no use 
of a composition scale such as that devised by Professors Hillegas 
and Thorndike, nor even of such mathematical compilations as were 
used in the ease of the Harvard-Newton Scale. This would have 
been beside the point. What was done by these teachers 1 repre- 
sents the possibilities in the ordinary elementary school where the 
work is done by a group of teachers working without the aid of 
statistical experts. That very great value results from such at- 
tempt at standardizing, no one who has had contact with it can 
doubt. In contrast with the composition standards recently pub- 
lished by the Board of Education of the City of Detroit, these re- 
sults are doubtless relatively inaccurate, for in that case the persons 
who graded the compositions had trained themselves by an exten- 
sive period of use of the Hillegas Scale. So far as the present writer 
has tested the abilities of ordinary teachers to grade compositions 
by means of the scale, his results accord with those of Kelley as 
announced in his ' ' Teachers ' Marks. ' ? While the extreme variation 
of the grades given with the help of the scale is less than those given 
without it, the median variation is even greater. This signifies that 
in order to work out standards in the elementary school with the 
help of the scale, it would be necessary to train, a committee as 
was done in the case of the Detroit investigation. 

One of the most interesting points in the work of the Parker 
teachers is their attempt to select compositions good in form and 
poor in thought and the reverse. It will be noted that in some cases 
it was not possible to find examples of these sorts. Such composi- 
tions do exist, however, and their presence suggests the futility of 
attempting to assign grades to school compositions without consid- 
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ering content and literary form as contrasted with conventional 
usages in spelling, capitalization, punctuation, and grammar. It 
is probable that those who grade by means of the Hillegas Scale are 
led ultimately to ignore all such elements of composition as are 
not represented in that scale. This, to be sure, may result in a cer- 
tain superficial uniformity, but it is decidedly objectionable from 
the standpoint of class work. Of course, it is generally conceded 
that the use of such a scale should be in supervision and not in 
teaching. 

COMPOSITION ST.AOTARDS BY GRADES 

GRADE n 

8 

I went to Jackson Park yesterday. I picked up a whole lot of little shells. 
I found a shell that was shut and I opened it and there was nothing in it. 



Yesterday I played paper dolls with my sister. We had lots of fun. Then we 
had lunch. After lunch we played paper dolls again. Then my "big cousin 
came from college. We got her to make some dresses for our paper dolls. 
After she was done we played jacks 

a. P. 

Yesterday I played with a girl 

We went to get my jumping rope 

On the way up the steps we found a baby kitten 

He was hungry 

We gave him some milk 

Then we took him bake to the place where we found "brm 

Then I went in the house and my supper 

G a 

Yest I went to church. It was childrens Day. The hoys and girls spoke and 
sang. I went up on the platform and sang a song. The children were happy 

p a 

(Missing) 

F 
My father took me to the woods. I picked pretty flowers. 

GRADE m 

8 
The Bobins 

Last summer I was playing and I saw a nest. I went home and told my 
mother. Then my mother and I went down to where the robins nest was. 
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And we saw two robins go to the nest. One day we bought some food for them 
and the next day it was gone. One day we went to see them and they were 
gone. Then we waited a couple of days to see if they would come back and 
they didn't. So we took the nest home. 



My Experience 

When I was two or three years old I went with my mother and father 
on a fishing trip. W~hen we got there we had to sleep on the ground with 
blankets. My dady cought a little fish and gave it to me but I was not big 
enough to hold it so I let it go. When we went home there was a hoot owl 
and I was afried of it and hid under the covers. 



The Wreck 

When I was out at my grandmother ; s she to my sister and I to go for the 
paper so we went up to the station and then we heard a loud wist but we did not 
what it ment so we went on after a while to trains bumped togather and many 
people were hurt with broken arms and legs. The Biverside station was broke 
a the side and we had to go away to to a little store by the river and my grand- 
mother asked us what kepd us so long and we told her what happen. The next 
morning the trains were running. I was surprize to see the trains running 

a a 

My Garden 

A half of Saturday I was making my garden. I took a shovel and dug 
the dart up. Then I too the rake and raked the dry grass away. Then I 
got som soda and put it in the garden. Do you want to know what I put in 
my garden? I have put into my garden, radishes, geraniums, panseys, tulips, 
lettuce, and beans. I hope they grow. If they do I will bring a bunch of 
flowers to school. 

pa 

(Missing) 



On Easter 

On Easter I went to my friends house. We had Easter candy and we had 
some colored eggs. We had some eggs for supper. Then my sister and I 
went out to play. We had a good time on Easter. 

GBADE W 

8 

An Incident of My Life 

Once when I was about two years old something happened to me. It 
was when I lived in East St Louis. We have a great many chickens at the 
time. My mother was out feeding them and I was on a box by tho window 
watching. All of a sudden the box slipped and my nose landed on a nail. 
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That is how I got the sear on my nose. It looks something like a horse shoe 
and I have always had good luck after that. 

E 

"When I Was Operated On 

When I was going to the Englewood hospital my father came and took me 
there. Then a nurse came and took me out of the auto and took me to a 
little room then I had to wait about three hours for the doctor. The funny 
part was that I was not sick at all sick when I got to the hospital but they 
made me sick. The doctor eame with four nurses to get me. He had a long bed 
on wheels and he put me on it. Then he brought me to the operating room. 
Then they layed me on a long bed. Everybody in the operating room had 
white on. Then a nurse brought a little can of ether and put me to sleep. 

GP 

(Missing) 

G a 

All Prom a Little Match 

One day when Llewelyn and I were up at Ms house Llewelyn lighted 
a match we were but babies and he threw it in the wastepaper basket. It 
was not much of a fire but it could have done a great deal of damage to the 
flat Llewelyn lived in. Llewelyn screamed as hard as he could and Esther 
came running in and she screamed to. Then Mrs Abbott came running in and 
threw some water on the fire. Then my grandmother came and took me home 
and I had a big spanking. 

pa 

My Experiences on the Earm 

During moving week I went down to Mattoon, Illinois, and stayed all 
week. On Thursday I went to the country and stayed until Saturday afternoon. 
I had a very nice time, too. Friday Thelma and I went out to the chicken 
farm and they have an old turkey gobbler of which I was afraid because he 
acted so proud that h0 scared me badly. But I had a very nice time. 

F 

On the Farm. 

When I go to my grandpa's I feed the horses and the chickens. I like 
to feed the pids to. I liked to go to the hay field with the hayers. It is such fun 
to sit on the hay stack. 

GRADE V 

8 
Our Phonograph 

We have a phonograph in our home, near a window. I am very interested 
in it. Sometimes I devote as much as one half hour playing and listening 
to it. All of my friends and also my family enjoy this little phonograph. 
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One day while I was playing my favorite record, as I was taking it off 
it broke. I was so sorry, I couldn't be clieered up until I had another of the 
same song. I went to several stores but I couldn't find the same kind. The 
week after that my father surprised me with the same song. We have many 
other records, but none as sweet as this. 

One mo'rning when I woke up I found a new record. It was quite early in 
the morning. This was sweeter than any other record I had ever heard. I 
woke my mother up and said to her, "Isn't this record large? It is just beau- 
tiful." After I had finished playing it, she said "You are getting to like that 
phonograph too much." 

Then she went away, leaving me much excited. I think a phonograph is 
is wonderful. It is just made out of medal and sounds so human. 



A Horse Back Bide. 

One day I asked my father if I could go horse back riding, and he said, 
' ' Yes, if you know how to drive the horse 7 \ I said I knew and went to the 
barn. At first I saw no one to saddle the horse, but afterwards I saw one of the 
darkies called AreMe. I said to Mm, "Archie!, will you saddle the horse for 
me", and he said, "Certainly I will." So he saddled the horse for me and 
put me on the horse. I had not gone far when I came to a place with lots of 
green grass. I thought the. horse was hungry and I let M eat, but when I 
went to pull him away he would' not let me. I pulled so hard that I lost the 
reins and had to get down although I did not how to get upon the horse again. 
I got the reins over the horse's head, and pulled him up by the fence. He 
would not stand still long enough for me to get on his back. After a while I 
got tired of standing there so< I pulled him up again and got him to eating. 
While he was eating I got on his back and rode on my way. I did not let him 
eat any more grass. 

GP 

A Boy Scout Hike 

Holigan, Bab, Edgar and I went on a boy scout hike. We were going to 
summit. When we got there it was twelve o'clock. We were all hungry 
so we decided to cook dinner. Bab said, "That he and Edgar would build 
a fire if we got some wood. After dinner we started out to see what we could 
find. We were but a little ways when Edgar saw a snake. We let the snake 
alone and went on. After while I saw a big mud turtle. He was about a 
foot wide. We took Mm and threw Mm in the water. It started to rain after 
we were out there for about four hours. When it stopped! raining we ate sup- 
per. After supper we were sitting around our fire. Edgar started to running. 
We did not know what he was running after. Then we saw a little rabbit 
running in front of him. 

QG 

My Walk to Beverly Hills. 

Sunday my mother, my brother, my father and myself took a walk to 
Beverly Hills. My father said, "You and Daniel go walk along the sides 
and .maybe you wiU find some violets. We walked along the side and found 
many violets After we were between Beverly Hills and Longwood my father 
saw a green house it looked some-thing like a cMcken coop. When we got there 
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we found it a place were a man lived. As we passed through the country 
we saw fields of violets. 

We came to country school house about as big as a school room. Every- 
thing was curious to us, but if they came to where we lived they would thi-nlr 
the same. 

pa 

(Missing) 

F 
In the Country 

I went to the country and had a very nice time. It was raining when I 
got there and it was very muddy but I had my rubber boots along so I put 
them on and went to our cottage. I got my rain coat and went to the barn. 
I started to milk. Then I went to my uncle 's and stayed over night till Sunday. 
Then we went back to our farm. 



(Missing) 



GRADE VI 
8 

E 

An Incident on Horseback 



About two years ago this summer I was on a farm in New York State. 
It was near the village of "Jay. The people we were staying with kept a board- 
ing house as well as the farm. 

They had six horses, two buggy horses and four truck horses. I rode 
horseback on the smallest buggy horse. One day when I was horseback riding 
the dog (which 'belonged to the lady with whom we were staying) began to 
snap and bark at the horse. This got him nervous so in order not to be thrown 
I steered him around in a circle. The dog sat in the middle looking at us 
every minute but before long he got so dizzy that he could not get up. I 
thought we could get away before he recovered but I was entirely mistaken 
for when I pulled on the other rein the horse would not turn. We kept on 
in a circle until the hired man who happened to be in the yard came and took the 
dog away. I then stopped the horse. 

You may be sure I did not ride around the dogs again. 

GP 

Learning to Bide a Bycyele 

One day a girl friend of mine came over to my house. She brought her 
bycycle with her. I asked her if she would let me try to ride it, and she said, 
' ( Yes. ' ' I got on the bycycle and she held it up. It was rather hard for me 
to reach the pedals, but I managed to do it. I wanted to try to ride alone. 
but she said I might fall off. Just the same I would try to ride alone. 
I tryed to go alone but I could not. I would have fallen off if she had not 
been right along side of me. I rode along with her for a while, but I wanted 
to try to ride alone again because I wanted to show another girl friend of 
mine that I could ride a bycycle. Just as she let go of the bycycle I fell over 
onto the curbing and knocked one of my loose teeth, out that I was glad to get 
rid of. I had a nice time but I will never try to ride a bycyele alone again. 



54 THE SEVENTEENTH YEARBOOK 

aa 

A Boat Trip 

Last summer I went to Milwaukee on a steansMp. We left down town at 
about nine o'clock A. M. We had a very good time on the boat. At noon time 
it was fun throwing crusts of "bread into the water and watch the birds get 
it. We got in Milwaukee at two or three o'clock P. M. We hired a taxi and 
saw some of Milwaukee. In about an hour the ship was ready to sail back. 
When it was dark it was fun sitting on deck. We pretend when ships came 
behind us that they were pirate ships and we were trying to escape. We 
landed at about nine o 'clock P. M. When we got home I was so tired I slept 
till about non the next day. 



What I Did Between Friday and Monday 

Friday night I went to the, Harvard Photoplay House, to see, " Little 
Mary Sunshine". It was very good. 

Saturday I read and played with some girls. The name of the book I 
read was, "Kebecca Mary". In the evening I went out with my father and 
Mother. 

Sunday I read some more and went away in the evening. When I first 
started out Sunday it began raining so I had to wait until it stopped. 

Monday I went to school as usual. That afternoon I played out doors 
with some girls. In the evening I did niy studying and then went to bed. 



Setting the Backkitchen Afire 

When I was a little boy I liked to play with fire, so one day I thought 
I would burn the papers, that were in the basket. It happened that the basket 
was full, so I went into the kitchen and got some matches. I did not bother 
to take the papers out into the alley, but set them afire right where they were. 
After I had them ablazing high. I went upstairs and told my mother that 
blachey set the papers, afire. Blaehey was our little cat, but my mother was 
glad I told her. She called up the fire department. They got to our house 
about an hour later, and by that time a boy had the fire out with our garden 
hose. 

GKADE VIT 

B 
A Dissapointing Hike 

Saturday I had a very funny but dissapointing thing happen to me. 
There were three girls and three boys altogether and we started out about 
noon with our lunches for some woods near Morgan Park. When we were 
about half way there it began to rain but we trudged on thinking that it 
would stop pretty soon. But oh no*! It kept right on raining harder and 
harder every minute. I felt as if my shoes were half full of water and my 
sweater was dripping wet. My hat had red poppies around it and red water 
kept continually dripping off the brim of my hat. My shoes were covered with 
black mud and my hands were wet and cold. Finally we got into the woods 
which were not very thick and which didn't shelter us much. One of the 
boys built a fire, out of some dry wood that he chopped out of the inside of a 
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log, so that we could get dry and warm and eat our lunch. The fire was very 
small but it was better than nothing so we took our lunches out and began to 
eat. We were all a droll looking sight. I couldn't see myself but I imagine 
I looked even funnier than they did, standing there beside the tiny fire eat- 
ing very fast to keep my food from getting wet and red water dripping on 
the ground and down my neck from my hat. Finally after vainly trying to get 
dry we started home. Later, when I was sitting next to the warm stove with 
a cup of hot tea inside me I breathed a sigh of relief and thought "Home, 
Sweet Home." 



My Mrst Bide on the Street Car Alone 

My most interesting experience was my first ride on the street car alone. 
I was nine years old and I was going to see one of my girl friends who lived 
on sixty-fifth and Kimbark Avenue. I was going to take my doll -with me 
and I had a great deal of trouble getting it dressed just so. It was at the time 
when they had open cars in the summer. I could find no place to sit but up 
in front with the moterman. When the conductor came up to collect my fare 
he said, "Well, who is this?" I did not answer him at first until he asked me 
what my name was. Then he saw my doll and said, "Oh! you have a baby 
with you. Well I guess I will have to charge you extra for it." I was be- 
ginning to get frightened at that but to change the subject I told "him to let 
me off at Kimbark Avenue. The moterman turned around and said, "I will 
take care of her, but you had better go and finish collecting your fares. 9 } After 
the conductor was gone the moterman started to talk to me in spite of the sign 
above Ms head which said, "Motermen must not talk to passengers." He 
asked me where I was going and if my doll was ever sick. Every once in a 
while he turned around and said, ' ' I think I hear your doll crying. ' ' 

I was glad when we came to Embark Avenue because I did not like to 
have everybody asking me questions. When the conductor lifted me off the 
car I found my friend waiting for me. When I told her what had happened 
in the car she laughed and I could not imagine why. 

GP 

A Thrilling Experience on Lake Michigan 

It was a windy and stormy day in October. My Sister Mother and I 
were up in Manistee Mich. We had been there all summer and were now 
anxious to come home. We telephoned th lighthouse to see if the water was 
rough. We found out that it was very rough and foggy. We were all very 
anxious to go home and so we telephoned the lighthouse once more. The 
water was not quite so rough this time and so we thought we would go anyway. 
We set sail that evening at about 6. o'clock. As soon as we reached the lake 
the ship rolled and tossed like a cradle. The wind blew like a cyclone wind. 
We finally decided to go to bed. The captain came along and offered to help 
us to our state room. My mother was leang on the wall outside of the state 
room when the ship gave a sudden lurch and the door slammed shut on her 
thumb. When the captain brought her in she had fainted. A matron came 
with some ice, but it did not do much good because her thumb was broken. 
Oh! how sick we were could not be explained. I hope never to have an ex- 
perience like that again altho it might have been worse. The captain said 
all *the dishes were broken and that the second deck dipped water. 
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a a 

What Disobedience Did 

It was in spring vacation and there was a building being put up at the 
corner of Sixty Seventh and Parnell Avenue. Every evening after the men 
went home some of my friends and I played tag on the elevator. My mother 
told me not to play there for I would get hurt. The evening after my mother 
told me not to play on the building the boys begged me to come and play. 
After a while I said I would blowing all the time that I was disobeying. 
I was up on the third floor (l which, was the roof" running as fast as I 
could to get to the elevator and slide down the rope. When I got to the ele- 
vator I jumped for the rope but missed. I went down, down, down and I 
didn't think I was ever going to land when I stopped with a jerk. A little 
while later I was surrounded with boys and was being brought home on my 
two brother's shoulders. When I got home my mother was so mad that I 
got a licking besides a gash in my leg from the fall. I think I had a good 
lesson for disobeying orders. 

PG 

A Disappointment 

The most disappointing experience that I can remember, is when I went 
to Eavina Park and sat on the pier all afternoon with a line and never caught 
any fish. 

We started for Eavina Park at ten o'clock and got there about twelve 

'clock. As soon as we got into the park my sister said, ' f let 's have some- 
* thing to eat. ' ' 

I said, "I second the motion". But mother wanted to stay in the park 
for a little while, so we stayed in the park until half past twelve. When it 
was half past twelve, brother said, "Ah, the stroke of half past twelve." 

We picked up our lunch and the wraps we carried and started for the 
beach. The beach was about a mile from the park so we had a long walk. 

When we got to the beach we built a fire and made some coffee. After 
dinner mama, Evelyn, and Papa and Myrtle went to the concert. 

Brother got the lines ready and put the bait on them. He gave me a line 
and said, "Sit still now or you'll scare the fish." I was perfectly disgusted 
to think that brother didn't think that I knew enough to sit still when I was 
fishing. 

I sat and sat, but nothing bit at the bait. Finally I got tired and told 
brother I was going down to get a cookie. Brother held my line for me until 

1 got back, but then I had to take it again. 

It was three o'clock before the folks got back and I hadn't caught a 
fish. 

F 
Catching Turtles 

Last summer another boy and I went to catch turtles. We rowed to a 
place where there was some. Pretty soon we saw some on a log. I rowed the 
boat slowly up to where they were sitting, then I gave a lunge forward and 
pushed the oars with all my might. At the same time off jumped, the turtles 
into the water. They swam under the weeds, and sea-grass, I grabed the oar 
and fished three of them out and almost tiped the boat over becides. We got 
them all right and put them in the boat. Two' of them were snapping turtles 
and one was not. The latter had a shell and all colors. W took them back to 
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the cottage and played witli them for a while, and then we put them in the 
lake. 

GSADE YIH 

8 
A Daring Leap 

While down town, walking Tip State Street a short time ago with Mother, 
I saw a man narrowly escape death. We had just reached the north side of a 
crossing where the traffic was controlled by a policeman, when I happened to 
look up the street. For a wonder, it was fairly clear of automobiles and other 
traffic. Suddenly, I was attracted by a red and yellow racer, coming toward 
me at a fast clip. 

When the racer was about a block away, a loud report came from it. 
Also, a cloud of smoke which completely enveloped the striped automobile. 
Out of the smoke shot the speeder, coming on at a dangerous rate. The 
thing came nearer and nearer to the crossing. Would it reach, there before 
the whistle blew? As the policeman was busy, he had not seen the fast 
approaching speed-demon. Then the whistle blew and directly into the path, 
of the racer, lumbered a big, heavy, auto truck. The ear was no only a hun- 
dred feet away and the driver, a young man, was fumbling with the steering 
gear. The glimpse I had of Ms grim face showed no signs of fear, although, 
it was a chalky white. Quickly, the driver slid from his seat to the running 
board poised himself for a second and then jumped. 

Not a second too soon, for the nest instant the car crashed into the big 
truck. Bang! went the gasoline tank, and when the smoke cleared, the racing 
automobile was scraps and the truck badly damaged. The man had luckily 
fallen into a clear space but did not move. Evidently, he was badly hurt. Up 
came the policeman in charge of the street and carried him to the sidewalk. 

A man in a store nearby had telephoned for the ambulance, so in about 
five minutes, the injured man was on his way to the hospital. Mother and 
I then went on. 

The only way that I can account for the accident is that he had broken 
both his brakes and steering wheel at the time of the car being surrounded 
by smoke. Really, I do not care to see such a thing again. 

E 

Breaking a Door Glass 

Toung as I was, I was very fond of marbles, especially those brown, hard 
ones that were six for a cent. I was always using them when I should have 
them put away. It was one Sunday, when I was told to put them away, that I 
disobeyed, and took them with me to a friend's house. 

It was great sport, throwing my marbles against the stone stairs and 
catching them as they bounced back to me. But my fun was soon spoiled by a 
marble which went too high and broke the large, engraved, plate glass door that 
led from the porch into the house. My mother was summoned and I was told, 
in fact I knew very well, what would happen when I got home. As I was very 
small, I threw the marble into a sewre thinking that would help matters but it 
did not. This combination of pleasure and misfortune cost my father! thirteen 
dollars and a half. 

GP 
A Night in the Swamp 

One day, my chum and I did not have anything to do so we decided to 
go out on the swamps which were about a mile from my house with our twenty 
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two's and look for muskrats and other small game. We started about half 
past twelve or one o 'clock in the afternoon. My chum had his Irish setter with 
him and we anticipated a goodtime. As the afternoon advanced we got farther 
and farther into the swamp and we had) not yet raised any game exccept one 
muskrat which we both fired at and both missed. About six oelock we were 
ten miles from home and night was coming on fast. 

"We quickly turned around and started on the run for home. We had 
gone about a half mile when we suddenly missed my chum's dog. We called 
and called but he did not come. My chum said, "I think he must have been 
caught in a muskrat trap. We had better go back and look for Tirm. ' ' So we 
turned around and went back. We searched for over an hour before he was 
found. It was just as we had thought. The he was with both hind feet in a 
trap and it must have hurt him because he was whimpering. When he was 
released he could hardly walk. We again started and had to go .very 
slowly on account of the dog. It was eight oelock and we were still seven or 
eight miles from home. We walked on and after what seemed ages we came 
to the toll gate, which was a lift bridge over a small river. But to our dismay 
the bridge was up for the night and there was no light in the keepers hut. We 
yelled and threw stones but it seemed that the toll keeper had gone to town. 
We looked for a boat but they were all on the other side of the river where all 
the people lived. At eleven oeloek the man who tended the bridge came home 
and we got across. We did not have any toll money and as he felt sorry 
for us he let us across free. We ran like everything and were soon home. It 
was twelve oelock when we got home but nobody was home. They were all out 
looking for us. At two oelock they came home. They thought we had gone 
on to the next town until the man at the bridge told them he had seen us going 
towards home. They were so glad to see us they forgot to scold and we got of 
free. But we decided or rather our parents decided the next that we would 
never go into the swamp without a grown up person with us. 

GG 

A Snake Hunt 

Two years ago in the southern part of Illinois, my cousin and I went 
snake hunting. He had a golf -stick and a knife and I had a small pistol. 
With this equipment we started to a large pond on my Uncle ; s farm. Into this 
pond flowed a small creek, soj we followed it for at least an hour and had not 
seen a snake. I wanted to go back home but he wanted to go' on a while longer 
so I went with him. 

We walked and watched for snakes until we saw one which we killed. 
Then we happened to take notice of our whereabouts and we decided to start 
home for it was getting dark. 

So we started! home on the run, but it soon became so dark we could not 
see the creek any longer, we had to wade in the water to know where we wer& 
going. It took us about an hour and a< half to get home where we ate a big 
supper and then we told our story and which made everyone laugh and tease 
us about not knowing enough to come home when it started to get dark. That 
experience made us not want another snake hunt. 

PG 

Locked Out for the Evening 

One afternoon as I was playing with a friend of mine in the house, we 
decided to go outside and play. When I came from school I had my coat on 
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and the key in. my pocket, but as it was warmer now than it had been I put on 
my sweater. 

1 i Come on, ' ' 1 said to my friend. At this we both ran thoughtlessly out 
of the door and just as it closed I exclaimed "What will we do? I left the 
key in my coat pocket. It is mother's key and papa will not get home until 
half past nine. ' ' 

' ' Well you 're a great one. But accidents will happen. ' 7 

We went to the back door to see if any window might be open or any 
possible way of getting into the house could be found. But alas! All the 
windows were down. 

' 4 Mother is coming on the elevated so I '11 go and tell her the sad news, * ' 
I said. 

''Goodbye then I hope everything turns out all right," was my friends 
parting reply. 

"I do too," I answered. 

Then just as I left her it began to rain, and it came faster and faster 
until it was really storming. At the station I waited and waited and at last 
my aunt appeared, but not my mother. 

'Where is mother?'' I questioned. 

e She went home early because she had a bad head-ache. Why are you 
here? ' 

* 1 We 're locked out and mother has a head-ache, ' ' I exdaimed. 
' I knew this would happen sometime when you had the key, but come on 
over home with me and your mother can lie down, ' * my aunt said. 

' ' That surely is a relief, ' ' I said with a sigh of relief. 

Of course this wasn't a nice situation but it was better than being in the 
rain until nine thirty, for we went to our house and found mother on the steps 
and then went to my aunt's for the evening. 

F 

A Lesson) That I Learned When I Was Small 

I had gotten my experience by handling a razor without permission. My 
father generally puts his razor away every time he uses it, but that day he left 
it on the window sill. I took it out of the ease and examined it. After turning 
the blade around several times, it cut through the skin of my finger, quite deep. 
The blood started to circulate very rapidly. I certainly knew enough to leave 
razors alone after that. 



CHAPTER YI 

A SUMMARY OF TEN RECENT INVESTIGATIONS IN THE 
FIELD OF ENGLISH 



Prepared under the direction of James Fleming Hosie, Chicago Normal College. 



Breed, Frederick S. and Frostie, S. W., Measuring English composition in the 
sixth grade. Elementary School Journal, 17: January, 1917, 3-07. 
Four hundred eighty-one samples of English composition on the same 
subject were written under relatively similar conditions. Three competent 
judges graded these compositions independently into ten groups. The samples 
were then arranged in such manner that the poorest specimens were placed in 
Group one, the next tol the poorest in Group two, and so on to the best group, 
which was marked ten. The reports of the three judges were then tabulated 
and a set of seventy samples chosen for further investigation. The seal was 
constructed by selecting from the seventy samples in a manner similar to that 
employed by Professors Thomdike and Hillegas. 

Courtis, S. A. and Beverley, Clara, English Composition. Detroit: Board of 

Education. Pp. 158. 

A. volume of compositions illustrating the written work of the children 
in the Detroit elementary schools. The compositions were evaluated with the 
help of the Hillegas Scale by a committee specially trained for the purpose. 
This committee was made up of the supervisor of English in the grades, Miss 
Clara Beverley, and the supervisor of educational research, Mr. S. A. Courtis, 
together with Mr. Courtis ' assistants. Among the other material in the volume 
is a scale evaluated in the terms of the Hillegas Scale and also in terms of the 
teacher 's mark for the grade. Set CC J" of the Thorndike collection of English 
compositions for practice is reproduced entire, together with the values in terms 
of the Hillegas Scale. TTie supply of the pamphlet is limited. Those interested 
should correspond with Miss Clara Beverley, Office of the Superintendent of 
Schools, Detroit, Michigan. 

Diebel, Amelia and Sears, Isabel, A study of the common mistakes in pupils* 
written English. Elementary School Journal, 18 : November, 1917, 172. 
This study should be compared with a similar one made upon the oral 
English of exactly the same number of pupils ir^ the same grades of the same 
schools in Cincinnati, and reported in the ISlementaryi School Journal for Sep- 
tember, 1916. The authors state that * ' the main question in the teaching of 
written English, as revealed in the papers examined, is not so much one of the 
use of language as of punctuation, composition form, and carelessness these 
three items supply 66 percent of all the mistakes made." 

Haggerty, M. E., Measurement and diagnosis as aids to> supervision. School 

and Society, 6: September 8, 1917, 271. 

This study represents an attempt to follow the progress of certain ele- 
mentary pupils by means of the Hillegas and Harvard-Newton composition 

60 
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scales. Approximately 300 children, eight principals, and as many teachers 
were concerned in the investigation. No definite conclusions are drawn, except 
that more accurate scientific methods are needed in supervision than we have 
been employing. 

Johnson, Eoy Ivan, The persistency of error in English composition. School 

Review, 25: October, 1917, 553. 

This reports an investigation carried on in the Junior College of Kansas 
City. It is listed in the present connection because of the fact that it is an 
aftermath of the work carried on by Professor Charters and reported at length 
in the Sixteenth Yearbook, Part I. Mr. Johnson draws the conclusions that it 
is necessary to take into account both persistency and prevalence in determining 
the order of needed increase of emphasis in the teaching of correctness. This, 
he thinks, may be done by making a ranking of the sums of the ranks of each 
class of error in persistency and prevalence. He believes that there is very 
much greater need than is realized of drill in the mechanics of writing to 
bring about habitual accuracy. The decrease in ungrammatical sentence struc- 
ture, mistakes in the case of pronouns, and misspelling is highly gratifying. 
There is also marked increase in ability shown by the college freshmen in the 
handling of "the more difficult forms of discourse description and exposi- 
tion. J J This increase of ability may be dependent somewhat upon the natural 
increase in maturity of thought power. 

Mahoney, John J., Standards vn English A Course of Study in Oral and Writ- 
ten English. School Efficiency Monographs. Yonkers-on-Hudson : 
"World Book Co., 1917. Pp. 198. $ .90. 

This monograph is of the same character as Sheridan's Speaking and 
Writing English. Indeed, the two men worked together for three years in the 
development of a set of standards and then published their material separately. 
Of course the illustrative compositions, as well as the text, are widely different 
in detail. The two together constitute the most considerable contribution yet 
made to the problem of definite organization of oral and written composition 
work in the elementary school. Specific standards of attainment are set up for 
each grade and very helpful suggestions are made for reaching these attain- 
ments. No objective measurement, however, was used in determining the val- 
ues of the illustrative compositions. It will probably appear, when they are 
tested, that there is considerable unevenness in the steps from grade to grade. 
Both volumes should be in the hands of all supervisors of English and, if pos- 
sible, in the hands of all teachers of the subject! as well. 

Eandolph, Edgar D., Conventional aversions versus fundamental errors in 
spoken English, Pedagogical Semwary, 24: September, 1917, 218. 
This investigation, carried on in the Speyer School of Teachers College, 
Columbia University, was previously reported by Professor Charters in the 
Sixteenth Yearbook, Part I. The article is listed here for the convenience of 
those who wish to examine thel material at length. It is especially interesting 
because of the number of examples quoted with comments. "What is needed is 
to collect a large body of actual work of children in order that sound conclusions 
may be drawn. 

Sheridan, Bernard M., Speeding and Writing English. Chicago: Benjamin 

HJ Sanborn & Co. 1917. Pp. 162. 

"A course of study for the eight grades of the elementary school, with 
practical suggestions for teaching composition and a full set of composition 
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standards. * y This is a, revision of the pamphlet with, the same title which was 
published by the Board of Education of Lawrence, Massachusetts, in October, 
1915. ' ' Several new chapters have been added to Part I in the present edition. 
These, for the most part, are taken from the author *s Suggestions for the Im- 
provement of Written Composition, published privately in January, 1917. Care- 
ful revision of other parts of the work has been made wherever the results of a 
thorough trial of the plan in Lawrence have seemed to justify it The num- 
ber of illustrative compositions has been considerably increased. " (See 
Mahoney.) 

Thoradike, Edward L., Tests of esthetic appreciation, Journal of Educational 

Psychology, 10: JNTovember, 1916, 509. 

TMs article includes judgments of geometrical forms and judgments of 
verse. The essential feature in the latter consists in the appreciation of the 
quality of a line of poetry written to complete a couplet, the first line being 
given. In each case a line of poetry is completed in six different ways and 
the judges are asked to decide which is the best. The judgments are arranged 
so as to show the presumably correct order for each set of lines of poetry and 
the quality of some extra lines. 

Trabue, M. B., Supplementing the Hillegas "Scale, Teachers College Record, 18 : 

January, 1917, 51. 

This scale is made up in part of compositions written in the course of a 
survey of the schools^ of Nassau County, Long Island, by the Department of 
Educational Administration of Teachers College in 1916. The upper end of the 
scale, however, is taken from! the Hillegas Scale. The method of derivation is 
essentially that worked out by Professor Thorndike and Professor Hillegas, 
with variations which cannot be described in a brief review. Undoubtedly the 
scale represents a step forward in the refinement of the tool. Perhaps its most 
striking feature is a composition graded approximately at zero which was 
actually written by a school boy. 



CHAPTER VII 

THE CONTENT OF THE COUESE OF STUDY IN CIVICS 



B. B. BASSETT 
State University of Iowa 



AIM 

In the following pages the writer will endeavor to set forth 
in a summary way the aim and method of an attempt to discover 
what should be the content of the course of study in civics, and the 
main results obtained. 

The investigation was undertaken with the conviction that 
the function of civic instruction is to prepare the pupil for citizen- 
ship in a democracy; that such instruction implies preparation for 
the intelligent exercise of the elective franchise to the purpose that 
the voter will not be "satisfied with merely going through the mo- 
tions of government" but that "when he goes to the polls on elec- 
tion day, he will feel the thrill of executing an actual judgment;" 1 
that this result is to be obtained in part by the cultivation of civic 
judgment 2 through the exercise of the mind upon concrete problems 
that confront the American electorate. The aim, therefore, of this 
investigation is to determine what are the most significant and most 
persistent problems of the American people which seek solution 
through the machinery of government. 

DATA 

The specialist in any line of work is most conversant with prob- 
lems peculiar to his own field of endeavor. For this reason, in seek- 
ing to ascertain what problems are of most value for educational 
purposes, the writer has consulted the specialist in politics, viz., 
the professional politician. 



Wilson The New Freedom, p. 256 
'Arthur Dunn. Community and the Citizen, p. xii. 
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In political platforms, state and national, have been preserved 
for us during a period of three quarters of a century, the carefully 
formulated opinions of these politicians (and shall I say statesmen?) 
as to what our problems are. 

"Walter E. Weyl says: "A platform does not show what the 
politician wants; but does show what that astute person believes 
that the people want. The superlative value of the platform as 
evidence is due to the fact that it is always addressed to a potential 
majority." 

DIVISIONS OF THE STUDY 

The writer has divided this study into the following parts: 
(1) an analysis of the national platforms of all the political parties 
since the first National Convention in the year 1832; (2) an anal- 
ysis of the state platforms in non-presidential years from 1889 to 
the present time so far as they deal with national issues; (3) an 
analysis of all state platforms of the major parties in one year 
(1910) ; (4) an analysis of the platforms of the major parties in 
certain selected states, viz., California, Indiana and New York, 
since 1850; (5) an analysis of all platforms of the parties in Iowa 
since 1889, and (6) an analysis of the platforms of one Southern 
State. 

The States of California, Indiana, and New York, were selected 
because they are or have been in national elections 'pivotal' states, 
in which, therefore, because the balance of power was uncertain, 
political interest was acute. 

Iowa represents a conservative republican state which has had 
but one Democratic governor (Governor Boies) and has but once 
gone Democratic on the presidential ticket (1912). A state from 
the 'solid South' would, of course, represent the conservative Demo- 
cratic tendencies. 

METHOD OF ANALYSIS 

The units of measurement used were as follows: (1) The 
linear inch. This unit is entirely impartial and is justified upon the 
assumption that, given a sufficiently long period of time, the topics 
most discussed are most important. (2) Frequency of mention, 
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i. e., the number of platforms in which a given topic occurs. (3) 
Single platform proposal, i. e., the number of distinct proposals 
falling under each topic. These units will be illustrated by sample 
tables. 

Classification of Topics. It is evident that for purposes of 
comparison and evaluation the number of major topics in our clas- 
sification must be reasonably limited. It is equally clear that polit- 
ical proposals do fall into certain general classes; e. g., tariff, in- 
come tax, inheritance tax, poll tax, all come under ' taxation/ while 
taxation, national budget, national debt, etc., fall equally well under 
'public finance/ 

By trial, it was found that all political problems could be 
classified in the following twenty-six groups : 

1. Commerce, Foreign 14. Monetary System 

2. Corporations, Interstate 15. Moral Reform 

3. Constitution 16. Natural Eesources 

4. Defence, National 17. Office, Public 

5. Education 18. Parties, Political 

6. Finance, Public 19. Pensions 

7. Foreign Belations 20. Personal Eights 

8. Health 21. Postal Service 

9. Immigration 22. State Bights 

10. Industry 23. Suffrage 

11. Justice 24. Territories (and Dependencies) 

12. Labor 25. Works, Public 

13. Legislation 26. Miscellaneous 

The item * Miscellaneous' includes only unimportant state- 
ments, such, as preambles, conclusions, instructions to delegates, 
endorsements, principles, etc. 

In order that the further subdivisions of our groups may be 
better understood the following samples of the detailed classifica- 
tion of a few of the most important topics are inserted : 

6. Finance, Public * (b) Income 

A. Bevenue Beceipts Individual 

a. Taxation Corporate 

(1) Indirect b. Credit 

(a) Tariff Bond Issues 

(b) Excises c. Proceeds of sale of Public 

(c) Inheritance Tax Land 

(d) Emergency Taxes d. Proceeds of Government Bus- 

(2) Direct iness 

(a) Property B. Management 

Beal a. National Bank 

Personal b. Treasury Department 
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G. Appropriations B. Appointive (Patronage) 

a. Budget C* Competitive (Civil Service Be- 

b. Economy form, Merit System) 
D, Debt, Public D. Qualifications 

a. Repudiation B. Tentire 

b. Method of Payment P. Emoluments 
2. Corporations,, Interstate G-. Efficiency 

A. Transportation 15. Moral Bef orm 

a. Steamship A. Slavery Negro 

b, Railroads B. Liquor Traffic 

B. Communication, C. Marital Belations 

a. Telegraph a. Marriage 

b. Telephone b. Divorce 

C. Industrial (Trusts) e. Polygamy 
17. Office, Public d. Social Evil 

A. Elective e. White Slave Traffic 

a. Registration D. Penal Eeform 

b. Ballot a. Prisons 

e. Corrupt Practices b. Capital Punishment 

(1) Bribery E. Charity 

(2) Fraud F. Sabbath 

GL 



The application of this method of classification to national 
platforms is shown in Table I, which reads (taking corporations as 
a sample) as follows: i Corporations' ranked third in the total 
number of linear inches 370 during the year 1900. Some men- 
tion was made of this topic in six of the seven platforms. Of the to- 
tal amount^ the Democratic party devoted 142 linear inches (102+ 
22+18) of a total of 861 : the Eepublican party 30 linear inches 
of a total of 895; the Prohibition, none: the People's party, 81 
linear inches of a total of 546; the Socialist Labor, 24 linear 
inches of a total of 176; the Middle of the Eoad party, 26 linear 
inches of a total of 146 ; and the Silver Eepublican party, 67 linear 
inches of a total of 621. All other topics may be read in the same 
manner. 

Table II illustrates the same method of classification applied 
to state platforms and is interpreted in the same way. 

Table III illustrates the application of the ' single platform, pro- 
posal' as a unit of measurement. The table shows that there were 
twenty-two Democratic, and nineteen Republican proposals, or a 
total of forty-one proposals, with reference to corporations gener- 
ally ; of this number, there were four Democratic and two Republi- 
can proposals to abolish trusts, a total of six; of this number two 
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Democratic platforms favored "effective anti-trust laws," one com- 
mended the State's anti-trust law, and one urged tlie "abolition of 
tlie Smelter Trust/ 7 etc. Tlie grand total stows that there were 
561 platform proposals made with reference to corporations. 



TABLE I 

INCHES GIVEN TO VARIOUS ITEMS IN THE NATIONAL PLATFOBMS 1900 



Topics: 



Commerce 42 

Shipping Subsidy Bill 1 

Merchant Marine 2* 

Reciprocity 10 

G-rowth of Export Trade 24 

Corporations 

Trusts 102 30 

Republican Insincerity in Trust 

Legislation 2: 

Corporate Interference in 

G-overnment 18 

Government Ownership 

Defence 48 

Militarism 3! 

National Guard 3: 

Education 

Finance 

Dingley Tariff Law 11 

Republican Extravagance .... 9 

"War Taxes 9 29 

Protection {Policy Fruits ... 45 

Income Tax 

Foreign Relations 

Monroe Doctrine 48 5 

Hay-Pauncefoote Treaty ..... 8 

Alliance With England 33 

Sympathy With Boers 26 

Protection of Citizens 8 

Samoan Islands 25 

Hague Conference 5 

South African War 32 

Immigration 8 

Chinese Exclusion Law 8 

Mongolian and Malayan 

Asiatic 

Labor 

Department of Labor 23 

Injunction Black List .... 

Arbitration 9 

Industrial Education J 3 

Child Labor 3 

Convict Labor 3 

Labor Insurance 2 

Mining Trouble in Idaho 

Evils of Industrial System .... 

Legislation 

Direct 3 

Initiative and Referendum .... 

Monetary System 

Free Silver 28 39 

Currency Bill 53 

Monetary Legislation 41 

Gold Standard Act 

Refunding in Q-old Bonds 

Payment of Bonds in Gold 



35 



17 



24 



14 



32 



79 



20 



26 



121 



370 



143 



7 
137 



264 



49 



168 



17 



45 



479 



14 



15 
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TABLE I (Concluded} 



Topics : 


1 

P 


I 


I 


1 

ft 


,0 

oh 


1 


03 

OQ 


3 


& 

1 


I 


Bank Circulation 








6 














Authorized Bond Issue 








20 






















31 






























261 


1 


5 


Liauor 






91 
















"Forsisrn Liouor Policy * 






170 
































86 


3 


12 


Land Monopoly Homesteads . 
Land Monopoly Alien Owner- 
ship Reclamation 








27 




21 


38 


73 


5 


13 


(Popular Election of Senators. 


7 


25 




7 






11 
16 








Direct Vote Pres., V. Pres., 












7 












19 


28 




19 






23 


89 


4 


11 


Postal Service ........ 
















6 


1 


18 






6 


































43 


2 


16 






19 


























24 






























504 


4 


1 




57 
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Philippines ........ 


85 






39 






25 








Taxation of Porto Rico . . 


42 






28 






15 








Pledge to Cuba 


31 


8 










5 








Statehood, N. Mex., Ariz., Okla. 
Home Rule for Territories. . . . 


12 
8 


7 
4 




7 






7 












61 


































106 


3 


10 


Nicaraguan Canal 


17 


7 










7 








Reclamation of Arid Lands . . . 
Public Roads . 


9 


18 
14 










34 
34 
























1044 








30 


53 


27 


22 




24 


76 












146 






















41 


















Appreciation of women ... 




18 


















Conclusion 


28 


10 


23 








9 














165 
















Arraignment of Administration 
Appeal to Christians . t . . 






153 
121 


















25 








48 






















25 












Totals 


861 


895 


750 


546 


176 


146 


621 


3995 







The abbreviations used above for parties are as follows: Democratic 
(Dem); Republican (Eep) ; Prohibition (Proh) j People's (Peopl) ; Socialist 
Labor (S-Lab) ; Middle-of-the-Boad (M-R) ; Silver Republican (S-R). 
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TABLE II 

LINEAB INCHES GIVEN TO VAEIOUS ITEMS IN IOWA STATE PLATITOBMS, 1914 



Topics: 


1 


I 


1 


1 


o 

S 


3 



or 

1 


M 

a 




Commerce . . * 












6 


^ 


15 


Canal Tolls Exemption 


6 






















2 






79 


4 


6 


Physical Valuation, of ^Railroads. ........ 


1Q 
















Government Ownership, Telegraph and 


12 
















Carrier's Liability to Shipper Restora- 


20 
















Power of Cities to Own 'Public Service 
Utilities 










4 








Sherman Law Amendment 




7 














Trade rjQTmmissior* T r -, < - r - 




9 














Stock Issues Inter-State Corporations . . . 
Education ........ . . ...... . . . . 




15 
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3 


7 


Faith in Public Schools 




8 
















20 
















Vocation fvl E dn cati on 


25 
















Necessities of Life for Indigent School 
Children 










9 








Free Text-Books, Printed by State 










a 








Free Feeding of School Children 










4 








Finance 












251 


4 


1 


Democratic Tariff .. 




58 














]M'iTirmi'um Taxation . , ,, T ,,..,..,,., 




16 














Assessment Law . . 




21 














Corporate Tax State Amendment. ...... 




16 














Divorce of Countries from Taxation by 
State 




4 














Faith in Protection 




5 














Tariff Duties Based on Difference in the 




23 














Denunciation of Democratic Schedule. . . . 
Democratic Tariff . . 


21 


11 
















4 
















Distribution of National Treasury Funds 


12 


















14 
















Present Tax Law 






15 


















15 












National Tariff Plank 1912 






2 












Omnf-PftrtiffliTi Tariff Commission, . 








10 










Taxation of Wealth 








4 






















54 


3 


9 




16 


19 
















9 
















Colombian Treaty 






10 
























14 


2 


14 


Laws to Make Farm Life Attractive. .... 


6 
















Encouragement to Legitimate Business . , . 
Justice . 


8 










15 


1 


13 


Administration of Justice Free and 
Speedy . . . . ........ 










2 








Jury System~Extension ..... .... 










6 








Courts "Power to Declare Legislation 
Unconstitutional 










7 








Labor 












183 


5 


2 


Hours of Female Labor 


10 


7 














Prison Contract Labor 


12 


8 
















14 
















Wages Time of Payment 


S 
















Free State Labor Exchange. 


6 
















Child Labor . 


13 


11 






5 










7 
















Bureau of Employment in Department of 
Labor 


18 
















Products of State Institutions for State 
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TABLE II (Continued) 



Topics : 


i 

q 


P* 

1 





1 
to 


o 

& 


"3 

1 


o< 
? 

ft 


44 

1 


Use Only 
















| 


















I 


Safety and Sanitation . ... ... 










1 


























Sfatft ItfTTiploynf^nt . . * . . T - . . . 


















Eight-Hour Day 










1 








Labor Disputes; Use of Force and 


















Sight of Strike Boycott etc . . . 










12 








Equal Pay for Sexes 


















Union Label on 'Public Documents . 






























42 


4 


10 


Initiative and Referendum 


14 


18 






























I 














94 


4 


5 


Democratic Financial Legislation Evils. 
Rural Credits . . . 




ao 


10 
















21 














Banting and Currency Laws 


n 




















10 














T^fwrible, Sound. Currency ........ . . 








o 










Moral Reform .. 












121 


5 


4 


Prison Farms 




29 














Present Liquor Laws Endorsement .... 
Reformatories 


17 


16 














Prohibitory Amendment 






18 


5 










Prohibition 








10 










Repeal nf IVT^lct I/aw ....,...*,....,* 


















Marriage, Divorce, Polygamy, White 
Slave Traffic 


















Housing 










3 








Capital Punishment 










o 








Abolition of "War 










10 








Natural Resources 












5 


1 


16 


Conservation of Iowa Lakes 




5 














Office 












123 


5 


3 


Elections 
Southern Election Laws 




12 














Short Ballot 




15 














Judicial Primary Law 




12 














Absentee Voting 


20 


15 














Revision of Primary Law 






11 


8 










Recall 








o 


8 








Popular Election of Senators 








11 










Civil Service Employees, Right to Par- 
ticipate in Politics 










7 








Spoils System 




8 














Parties 












23 


1 


12 


Representation in Convention Propor- 
tional to "Vote in State 




15 














Basis of Representation Present . . 




3 














Personal Rights 












4 


1 


17 


Free Speech, Free (Press, Assembly. . 










4 








Suffrage , 












26 


4 


11 


Woman 




14 


5 


5 


2 








Works 












58 


4s 


8 


Road Laws, Waste, Inefficiency 


12 
















Panama Canal Completion 






g 












Iowa Road Law 




32 




5 










Home Rule for Cities 










2 


2 


1 


18 


Miscellaneous 












527 






Preamble 








14 


14 








Conclusion 




15 




14 










Address on Socialism 










295 








Democratic Incompetency 




10 














Endorsement of Congressional Delegation. 
Endorsement of Governor 




22 
11 
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TABLE H (Concluded) 



Topics: 



Denunciation of Republican Senator . . 

Need of Representatives in Sympathy 
with. People and Administration. . . . 

Endorsement of Administration ...... 

Revitalization of Principles of Decla- 
ration 

Greetings to Party Leaders 

Endorsement of Progressive Platform 
and Leaders 



28 



28 
43 



10 



Totals 



460J 562} 114| 117J 443[1696| 



TABLE m 

PROPOSALS IN STATE PLATTOBMS ABOUT STATE ISSUES IN 1910 



Classification of Proposals 



Democratic 
Party 



Republican 
Party 



Total 



Corporations, G-eneral 22 

1. Abolition of Trusts 4 

(a) Effective Anti-Trust Laws . . 2-0 

(b) Strict Enforcement of Anti-Trust Laws 0-1 

(c) Law Supplementary to Sherman Law.. 0-1 

(d) State Anti-Trust Laws 1-0 

(e) Abolition of Smelter Trust 1-0 

2. Regulation and Control of Corporations .... 2 

(a) Federal Regulation of Inter-State 
Corporations 0-1 

(b) Federal Regulation should be Supple- 
mentary to and not Prohibitory of 
State 1-0 

(c) Control and Regulation 1-1 

3. Punishment for Corporate Offences 4 

(a) Individual Punishment 3-3 

(b) Imprisonment of Corporate Officers for 
Political Contributions 1-0 

4. Specific Remedies for Specific Abuses 8 

(a) Provision compelling Corporations to 
Exhaust State Courts Before Appealing 

to Federal Courts 0-1 

(b) Prohibition on Political Contributions 1-1 

(c) Publicity for all Affairs of Corpo- 
rations 1-0 

(d) Prohibition on Fictitious Stocks and 
Bonds , 1-0 

(e) Party Pledge to Receive no Contribu- 
tions 1-0 

(f) Condemn Fire Insurance Companies 

as Trusts 1-0 

(g) Condemn Corporate Domination of 
State 1-0 

(h) Regulation of Smelting Charges 1-0 

5. Taxation of Corporations 1 

(a) Taxation of Corporate Shares Direct 

to the Corporation \ 0-1 

f b) Taxes on Gross Revenue 0-1 

(c) Taxes on Intangible Assets . .0-1 

(d) Collection of Just Taxes from Corpo- 
rations 1-1 

6. Justice for Corporations 3 

(a) Same Protection to Corporate as to 
Individual Property 2-0 

(b) Fair Treatment from and to Corpo- 
rations 1-0 

(c) Robertson Insurance Law 0-1 

(d) Restriction on Capitalization 0-1 

(e) Excessive Incorporation Fees ..0-1 

7. Cooperative Methods to Reduce High Cost 

of Living 



19 



41 



11 
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TABLE III (Concluded) 



Classification of Proposals 



Democratic 
Party 



Republican 
Party 



Total 



H. Public Utilities 32 20 52 

1. Regulation 16 11 27 

2. Specific Proposals of Remedies 9 6 15 

(a) Extension of State Railroad Commis- 
sion's Jurisdiction to Public Utilities 2-3 

(1>) Popular Vote on Franchise Q-rants . ..3-1 

(c) Publicity 1-0 

(d) Prohibition of Free Service to Public 
Officials by Gas and Electric Company 0-1 

(e) Extension of Power of Railroad and 
Water Supply Commission 1-0 

(f ) Arbitration of Disputes Involving 

Public Service Corporations 1-0 

(g) Provision Giving Public Utility Com- 
mission Power to Fix Rates 0-1 

(h) Stocks. Bonds, Rates 1-0 

3. Taxation , 7 3 10 

(a) Ad Valorem System 0-1 

(b) Physical Valuation 6-1 

(c) Excessive Franchise Taxes 0-1 

(d) Assessment and Taxation on Same 

Basis as Other Property 1-0 

IH. Railroads 37 27 64= 

1. Railroad Commission (ers) 10 8 18 

(a) Replacement by Public Service Com- 
mission 1-0 

(b) Election of R. R. Commissioners in 
place of State Board of Assessors 0^-1 

c) Increase of Power 2-2 

d) Extension of Jurisdiction 2-3 

e) Commendation of Service 1-2 

f ) Condemnation of Service 1-0 

g) Efforts to Wealcen Condemned 1-0 

h) Honest and Efficient Discharge of Du- 
ties 1-0 

(i) Popular Election of Commissioners 

Opposed 1-0 

2. Regulation O 4 4 

3. Rates 11 4 15 

(a) Freight 1-0 

(b) Passenger Fare 1-1 

(c) Freight and Passenger 7-3 

(d) Freight and Passenger Rate Dis- 
crimination 2-0 

4. Political Influence 6 6 12 

Intended Control of Legislative Action 1-0 

Domination of Party Councils 0-1 

, . Interference with Elections 0-1 

(d) Domination of State by Southern Pa- 
cific Bailroad 1-0 

(e) Political Bureau of Southern Pacific.. 1-0 

(f ) Anti-pass Laws 2-3 

(g) Permission of Passes to Specified Per- 
sons 1-1 

(h) Special Favors to Public Officials by 

Transportation Companies 0-1 

5. Physical Valuation 6 2 8 

6. Encouragement of Competing Lines 1 O 1 

7. Modernization of State Railway Laws 1 1 

8. Increased Railroad Facilities 1 1 

9. Abolition of Grade Crossings 1 1 2 

10. Approval of Charter Grant 1 1 

11. Maximum of Fourteen Hours for Trainmen 1 01 
Grand Total: 156 
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TABLE IV 

NATIONAIt PARTY PLATFORMS SUMMARY OF BA2STKS BY YEARS 







Commerce 


...... 5 15 14 4 14 11 9 9 9 15 1O 6 


Constitution 


....... 9 9 4 11 1Q 2 10 3 5 23 20 18 




39 11 14 8546333217 


Defence . . . . , ...... 


. . . . . 39 124 16 19 16 19 20 7 10 12 17 2 




, 17 6 1Q 16 13 9 19 17 18 24 21 20 


Finance . 


22 246 6 1 2 142 1 12 8 232 3 


Foreign Relations . . . , 
Health 


3344468 3344446 13 1 
....... 17 14 15 


Immigration . . . . . . 


5 6 8 7 11 7 7 12 10 5 11 8 10 18 14 16 2O 18 18 




14 12 13 16 5 




11 15 16 18 16 8 17 


Labor 


85 16 696576 1134 


Legislation 


4 4 10 9 9 14 15 18 15 15 14 11 23 17 


Monetary System . . . 


12 9 7 7 7 6 12 3 1 2 12 5 6 14 


"N"atTi Tali nation , . A . . 


, 12 12 2O 


Natural Resources 


8 5 11 7 6 8 11 12 8 2 7 8 12 8 4 12 


Office 


,.. 11 10 12 8 531237528 13 7499 


Parties 


2 1O 4, 2 16 11 9 5 


Pensions . . ....... 


. . . . 5 14 13 15 13 11 13 10 11 15 22 24 19 


Personal Rights 


, 6 8 5 1O 8 13 12 13 13 12 15 17 


Postal System 


11 13 16 18 17 18 17 21 19 16 


State Rights 


, 3 652 14 12 18 11 


Suffrage 


13 18 15 9 10 7 12 14 16 13 14 25 13 


Territories 


7 g 17 9 14 11 1 5 7 12 8 


Works 


10 7 7 6 9 17 18 17 15 17 10 8 10 7 11 




TABLE "V 

^FREQUENCY O3T RANKS 


Topics : 


1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 2Q 20+ 


Commerce 
Constitution .... .... 


111 311 22 
1111 21 111 


Defence . ........ 


1211 1111 2 21 


"K cln cfliti o m 


1 11 1 121112 


Finance ........ 


4822 2 1 


Foreign Relations . ... 
Health 


14721 1 
11 1 


Immigration 


2132 221 1 1 3 1 


Industry ...... 


1 1111 




1 1 1211 


Labor .... . . 


2 1123111 1 


Legislation 


2 211 223 11 


Monetary System .... 
Moral Reform . .... 


111 123 1 3 1 
7211112 11 


Naturalization .... . . 


2 1 


Natural Resources . ... 
Office 


1 1224 23 
12212 2221111 


Parties . . 


211 111 1 




1 12312 12 


Personal Rights 


11 2 1 23 1 1 


Postal System 


1 1 2221 1 


State Rights 


1111 111 1 
1 11 13211 1 1 


Territories 


1 1221111 1 


Works 


131131 1 31 
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TABLE VI 

TABLE OF COMPABATIVE BANKINGS 



Ranks 


All Parties 


Dem. Party 


*r > 


3 em. & Rep. 


Highest 
Five 


I 

n 
in 

IV 

V 
VI 
VII 
VIII 
IX 
X 
XI 

xn 
xin 

XIV 
XV 
XVI 
XVII 
XVIII 
XIX 


Finance 
Office 
Foreign Relat. 
Moral Reform 
Immigration 
Corporations 
Natural Resour. 
Labor 
Monetary Syst. 
Defence 
Works 
Legislation 
Commerce 
Territories 
Personal Rights 
Suffrage 
Constitution 
Pensions 
Parties 


Finance 
Foreign Relat. 
Office 
State Rights 
Territories 
Labor 
Legislation 
Corporations 
Natural Resour. 
Works 
Defence 
Moral Reform 
Immigration 
Constitution 
Personal Rights 
Pensions 
Monetary Syst. 
Commerce 
Parties 


Finance 
Foreign Relat. 
Office 
Commerce 
Natural Resour. 
Works 
Corporations 
Immigration 
Justice 
Monetary Syst. 
Defence 
Labor 
Territories 
Moral Reform 
Suffrage 
Postal System 
Constitution 
Parties 
Personal Rights 


Finance 
For, Rel. 
Office 
Nat. Res. 
Works 
Corporat. 
Labor 
Territor. 
Defence 
Immigrat. 
Commerce 
Mor. Rel 
Mon. Syst. 
Pensions 
State R. 
Constit. 
Justice 
Per. Right 
Legislat. 


Finance 
Mor. Ref. 
For. Rel. 
Office 
Corporat. 
Defence 
Labor 
Mon. Sys. 
Parties 
Constit. 
State R. 
Territ. 
Nat. Res. 
Legislat. 
Immigrat. 
Pensions 
Per. Right 
Industry 


XX 
XXI 

xxn 
xxin 

TTTV 


State Rights 
Education 
Postal System 
Justice 
Industry 


Education 
Suffrage 
Health 
Industry 
Postal System 


State Rights 
Education 
Health 
Industry 
Pensions 


Parties 
Suffrage 
Post. Syst. 
Education 
Health 




XXV 


Health 


Justice 




Industry 





INTERPRETATION OF DATA 

The material that has been presented in the preceding tables 
was subject to several methods of treatment in order to bring 
out its significance. Table IV shows the first step in the treatment 
by ranks. It reads as follows: commerce was not mentioned in 
political platforms during the years 1844-56; it ranked fifth in 
1860, was not mentioned in 1864 or 1868, ranked fifteenth in 1872, 
etc. 

Table V is derived from Table IV and reads as follows : Com- 
merce ranked fourth in one year ; fifth in one year ; sixth in one 
year ; ninth in three years ; tenth in one year ; eleventh in one year ; 
fourteenth in two years ; and fifteenth in two years. 

The following scale of value was then used to bring out the rel- 
ative ranking of these several topics throughout the entire period. 
The topic "Naturalization" occupied such an insignificant place 
that it was dropped from consideration. The remaining twenty- 
five topics practically cover the entire field of political discussion. 
Assuming that all occur in any one year and that the lowest ranking 
topic, the twenty-fifth, is to be given the lowest unit value, i. e., one, 
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the twenty-fourth, two, etc., we get from Table V the following 
result: 



Finance, Public 440 Monetary System 


261 Constitution 


154 


Office, Public 349 Defence 


224 Parties 


149 


Foreign Belations 342 Works 


221 State Bights 


137 


Moral Befonn 340 Legislation 


212 Education 


122 


Immigration 283 Commerce 


191 Postal System 


95 


Corporations 273 Territories 


187 Justice 


81 


Natural Eesourees 267 Personal Bights 


170 Industry 


70 


Labor 261 Suffrage 


159 Health 


32 


The Democratic Platforms were 


subjected to the same 


treat- 


ment, separately, with the following results : 


Finance, Public 408 Natural Resources 212 Commerce 


134 


Foreign Belations 274 Works 


211 Parties 


126 


Office 266 Defence 


209 Education 


77 


State Bights 254 Moral Bef orm 


191 Suffrage 


52 


Territories 225 Immigration 


19-0 Health 


41 


Labor 219 Constitution 


180 Industry 


32 


Legislation 216 Personal Bights 


164 Postal Sys. 


27 


Corporations 212 Pensions 


149 Justice 


17 


Monetary System 


146 




The Republican Platforms were 


subjected to the same 


treat- 


ment, separately, with the following results: 


Finance, Public 404 Justice 


204 Postal Sys. 


99 


Foreign Belations 350 Monetary System 


202 Constitution 


91 


Office 275 Defence 


199 Parties 


67 


Commerce 262 Labor 


197 Personal B. 


54 


Natural Besources 219 Territories 


187 State Bights 


42 


Works 211 Moral Befonn 


178 Education 


40 


Corporations 208 Pensions 


187 Health 


32 


Immigration 208 Suffrage 


130 Industry 


19 



In order to serve as a check on this result the five highest rank- 
ing topics in each campaign were evaluated by giving five points to 
first rank, four to second rank, etc. 

The results obtained were : 



Finance 
Moral Bef orm 
Foreign Belations 
Office 

Corporations 
Defence 



62 Labor 

42 Monetary System 

33 Parties 

23 Constitution 

22 State Bights 

18 Territories 



17 Natural Besources 5 

13 Legislation 4 

ll Immigration 2 

10 Pensions 1 

8 Personal Bights 1 

6 Industry 1 



The results of these various treatments are brought together for 
easy reference in Table VI. 



76 THE SEVENTEENTH YEARBOOK 

The second method of treatment designed to bring out the in- 
terpretation of the classified material, was the summation of linear 
inches devoted to each topic during the entire period treated. This 
is shown in Table VII, which reads as follows: Commerce was not 
mentioned until 1860. In that year 31 linear inches was devoted 
to its discussion; in 1872, 8 linear inches; etc., with a total of 966 
linear inches during the entire period from 1844 to 1916. This 
is 3 percent (true to 1/10 of a percent) of the entire platform dis- 
cussions of problems, and it ranked 12th in importance. 

If the entire period covered by the national platforms is subdi- 
vided into the Pre-Eeconstruction Period (1844-1868) and the Post- 
Keeonstruction Period (1872-1916) and the latter is again divided 
into two periods (1872-1892 and 1896-1916) we obtain an interest- 
ing table for comparison, Table VIII. 

TABLE VII 

LINEAB INCHES GIVEN TO VARIOUS ITEMS IN NATIONAL PARTY PLAT- 
FORMSSUMMARY BY YEARS 



Topics : 


1844 


1848 


1852 


1856 


1860 


1864 


1868 


1872 


1876 


1880 


1884 


Commerce 










31 






8 




17 


164 


Constitution 


19 


17 


67 


17 


9 


78 


7 


132 


98 






Corporations 




54 


44 




65 


5 
235 


95 


25 
95 


18 


44 
10 


159 
14 


Education 
















5 


84 


25 


19 


Finance 


, . . . 82 


103 


143 


99 


25 


28 


130 


161 


344 


93 


381 


Foreign Relations . 






100 


145 


32 


42 


68 


53 


53 




167 


Health 
























Immigration 


28 


28 


45 


51 


8 


25 


14 


23 


41 


51 


72 


Industry 


















11 




62 


Justice 




















20 




Labor 














10 


78 


3 


49 


99 


Legislation 


, ... 30 


33 


33 


33 










44 


17 


20 


Monetary System . 


. .. 5 












9 


47 


66 


49 


127 


Moral Reform . . . . 


... 536 


264 


275 


411 


219 


51 




38 


136 


265 


470 










11 


4 














Natural Resources . 


, .. 22 


30 


27 




20 


29 




43 


36 


19 


108 


Office 


8 


7 


18 


43 




38 


72 


162 


211 


120 


111 


Parties 








161 








B7 


133 


143 




Pensions 














43 


12 


31 


15 


56 


Personal Rights . . 


. .. 26 


26 


65 


32 




8 




22 


33 


18 




Postal System . . . 




3 


4 










7 








State Rights 


41 




62 


83 


74 












24 


Suffrage 








9 








4 


7 


35 


96 


Territories 


... 23 








19 












16 


Works 


9 


26 


47 


71 


17 










5 


15 


Topics : 


...1888 


1892 


1896 


1900 


1904 


1908 


1912 


19 leTotalPercentRank 


Commerce 


.. . 28 


69 


98 


121 


76 


60 


151 


203 


966 


3.0 


12 


Constitution 


... 132 


98 








'22 


43 


14 


523 


1.6 


18 


Corporations 


... 143 


112 


187 


370 


189 


572 


465 


175 


2529 


7.5 


4 


Defence 


... 13 


14 


18 


143 


41 


89 


56 


635 


1556 


4.8 


8 


Education 


.. . 29 


77 


19 


7 


2 


19 


37 


9 


332 


1.0 


23 


Finance 


... 476 


229 


433 


137 


224 


303 


431 


354 


4176 


12.9 


1 


Foreign Relations . 


. . 152 


166 


168 


264 


167 


187 


110 


815 


2689 


8.3 


3 


Health 












50 


92 


32 


174 


.5 


24 


Immigration 


... 93 


70 


24 


49 


9 


48 


52 


22 


803 


2.5 


14 


Industry 












75 


61 


258 


567 


1.4 


20 


Justice 


.. . 15 




29 




2 


57 


203 


23 


349 


1.1 


22 
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TABLE VII (Concluded) 





122 


125 


111 


168 


291 


635 


393 


299 


2383 


7 3 


5 


Legislation 




18 


35 


45 


20 


104 


24 


19 


475 


1 5 


19 


Monetary System .... 
Moral Reform . . 


66 
90 


190 
79 


731 
133 


479 
261 


36 
128 


216 

48 


228 
32 


51 
97 


2300 
3533 


7.1 
10 9 


6 
2 




6 


3 














24 


1 


26 


Natural Resources . . . 
Office ...... 


219 
124 


101 
194 


122 
99 


86 
73 


101 


159 
237 


372 

180 


77 


1470 
1798 


4.5 
5 5 


9 

jr 


Parties . 




37 






40 


126 


236 


99 


1012 


3 1 


11 


Pensions 


68 


61 


78 


89 


19 


38 


22 


10 


582 


1 8 


15 


Personal Rights 
Postal System 
State Rights 


4 


32 


41 
70 


6 


36 
6 


39 
53 


66 
43 
120 


19 
27 


392 
171 
527 


1.2 
.5 
1 6 


21 
25 
17 




102 


69 


40 


43 


24 


62 


18 


65 


574 


2 8 


16 


Territories 
Works 


93 

8 


58 
50 


75 
25 


504 
106 


136 
92 


185 
124 


112 

207 


145 
95 


1366 
897 


4.3 

2.8 


10 
13 



TABLE VIII 

SPACE GIVEN TO VARIOUS ITEMS IN NATIONAL PLATFORM& SUMMARIZED 

BY PERIODS 

,p p. cg - - ^ ~~~~~" 



Linear Inches 



Percents 



Period . . 



II III 



IV 



II III IV 



Commerce 

Constitution . . . . 
Corporations . . . . 

Defence 

Education 

Finance 

Foreign Relations 

Health 

Immigration . . . 

Industry 

Justice 

Labor 

Legislation .... 



Moral Reform . . . 
Naturalization . . 
Natural Resources 

Office , 

Parties 

Pensions 

Personal Rights . 
Postal System . . . 
State Rights . . . 

Suffrage 

Territories 

Works 



. 966 
. 523 
.2529 
.1556 
. 332 
.4176 
.2689 
. 174 
. 803 
. 467 
. 349 
.2383 
. 475 
.2300 
.3533 
. 24 
.1470- 
.1798 
.1012 
. 582 
. 392 
. 171 
. 527 
. 574 
.1366 
. 897 



31 

214 

70 

428 



610 

387 



199 





10 

129 

14 

1756 

15 

128 

186 

161 

43 

157 

7 

260 
9 

42 
170 



995 

309 

2459 

1128 

332 

3566 

2302 

174 

604 

467 

349 

2373 

346 

2286 

1777 

9 

1342 

1612 

851 

539 

235 

164 

267 

567 

1324 

727 



286 

460 

501 

146 

239 

1684 

591 



350 

73 

35 

486 

99 

545 

1078 



426 

922 

350 

231 

73 

43 

24 

313 

167 

78 



709 
79 

1958 

982 

93 

1882 

1711 
348 

1007 
861 
663 

1897 
247 

1721 

699 



816 
690 
501 
256 
162 
121 
243 
252 

1157 
649 



3.0 
1.6 
7.5 
4.8 
1.0 
12.9 
8.3 

.5 
2.5 
1.4 
1.1 
7.3 
1.5 
7.1 
10.9 

.1 
4.5 
5.5 
3.1 
1.8 
1.2 

.5 
1.6 
2.8 
4.3 
2.8 



.6 
4.4 
1.4 
8.6 
0.0 
12.4 
7.9 
0.0 
4.0 
0.0 
0.0 

.2 
2.6 

.3 
35.6 

.3 
2.6 
3.8 
3.3 

.9 
3.2 

.1 
5.3 

.2 

.9 
3.5 



3.7 
1.1 
9.1 

4.2 
1.2 



3.1 
4.9 
5.4 
1.6 
2.6 



13.2 18.1 
8.5 6.3 



.6 
2.2 
1.7 
1.3 
8.8 
1.3 
8.8 



.0 
3.8 
.8 
.4 
5.2 
1.1 
5.9 
6.6 11.6 
.1 
5.0 
5.9 



3.1 

2.0 

.9 

.6 

1.0 

2.0 

4.9 

2.7 



4.6 
9.9 



3.8 

2.5 

.8 

.5 

.3 

3.4 

1.8 

.8 



4.0 
.4 

10.9 

5.5 

.5 

10.5 
9.5 
1.9 
5.6 
4.8 
3.7 
10.6 
1.4 
9.6 
3.9 
.0 
4.6 
3.1 
2.8 
1.4 
.9 
.7 
1.3 
1.4 
6.5 
3.6 



Column I: 1844 to 1916 

Column II: 1844 to 1868 (Pre-Re construction Period) 

Column III: 1868 to 1916 (Post-Reconstruction Period) 

Column IV: 1872 to 1892s 

Column V: 1892 to 1916 

In Table IX is given the summary of all state platforms on 
national issues in non-presidential years from 1889 to 1914. The 
rankings in this table are determined by the number of distinct 
platform proposals. The scale of values used is the same as for 
Table VI (five highest rankings) . Table X shows the summary for 
the state platforms of 1910 on state issues; the unit used is the 
single platform proposal. 
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TABLE IX 



PROPOSALS IN STATE PLATFORMS ABOUT NATlOJNAJj. JLa&umo ^uxw-^ ^- 


Problems 


Ranks 
















I 
7 
3 
2 
3 
1 
1 

1 















11 

6 
3 
3 
2 
1 


1 

1 
1 
1 






0' 

1 







III 

4 
5 
1 
3 
1 
2 
2 

1 

2 

1 
1 









IV 

1 

3 
3 

3 
1 
2 
2 
1 
2 
1 
2 

1 
2 
1 

1 
1 
1 



V 


4 
2 
2 
3 


4 
3 
1 
2 
1 


2 
1 



1 


x5 
35 
15 
10 
15 
5 
5 

5 















24 
12 
12 
8 
4 

4 
4 
4 
4 

O 




4 






12 
15 
3 
9 
3 
6 
6 

3 

6 

3 
3 









x2 
2 
6 
6 

6 
2 
4 
4 
2 
4 
2 
4 

2 
4 
2 

2 
2 
2 



xl 


4 
2 
2 
3 


4 
3 
1 
2 
1 


2 
1 



1 


73 
48 
35 
34 
20 
16 
14 
13 
13 
11 
9 
6 
4 
5 
4 
4 
5 
2 
2 
2 
1 






L*Orp ail Rfprn 


M.oneiary oys 


P m ATY*A 


^omme ce . . . 


.auirr ge . . . 
























Health " 


Justice 



TABLE X 
PROPOSALS IN STATE PLATFORMS ABOUT STATE ISSUES, IN 1910 



Topics 


Number of Proposals 


Total 


Rank 


Democratic 


Republican 


Office 


248 
91 
80 
79 
59 
49 
43 
38 
36 

27 
19 
21 
5 
9 
6 
3 
3 
8 


130 
65 
73 
66 
51 
50 
37 
34 
24 
25 
19 
22 
15 
13 
6 
4 
4 
3 
13 


378 
156 
153 
145 
110 
99 
80 
72 
60 
55 
46 
41 
36 
18 
15 
10 
7 
6 
21 


1 
2 
3 
4 
5 
6 
7 
8 
9 
10 
11 
12 
13 
14 
15 
16 
17 
18 














T ilat* 11* " * 


Tridnstrv 


P f'fi tmn 
















Miscellaneous 



CONCLUSIONS 

It has been impossible in the space allotted to this review 
to present its methods and results in fullest detail, but even in the 
present incomplete form of the study a careful scrutiny of the sum- 
maries permits us to draw a few conclusions 

1. Certain problems, in their broad outlines, are necessarily 
persistent, since they are inherent in the structure or constituent 
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functions of government, e. g., public finance, public office, foreign 
relations and national defence. 

2. Certain other problems are persistent from tlie economic 
organization of society, e. g*, corporations (representing the cap- 
italist), labor (representing the producer), and natural resources 
(representing the third factor of production) . 

3. A third group of problems, which the writer has classified 
under "moral reform/' is necessarily persistent so long as there 
are men and women who are forward-looking, and subject to hu- 
manitarian impulses ; and so long as a democratic form of govern- 
ment renders all social problems potentially political. The term 
'moral reform' has been used in lieu of the more commonly em- 
ployed term ' social reform/ for the reason that a moral judgment 
rather than an economic or administrative judgment is the deter- 
mining factor in the voter's decision. 

4. Certain other problems are relatively persistent as corol- 
lary to our governmental or economic organization and status, e. g., 
immigration (a result of better economic opportunities in this 
country than obtain in other parts of the world) , foreign commerce 
(a result of our power of economic production), state rights (a 
result of the historic origin of the Federal government), consti- 
tutions (fundamental limitation of governmental action), and po- 
litical parties (arising from the problem of registering the popular 
will). 

5. The responsibility for the solution of these various prob- 
lems has been distributed among the three most important units 
of government in this country, viz., national, state, and municipal, 
or local, government. For example, foreign relations belongs ex- 
clusively to the Federal government ; conduct of elections and suf- 
frage qualifications largely to the states; education is delegated 
largely to the local units. 

6. There are certain tendencies evident from a careful study 
of the data: the problems of strict or liberal construction of the 
Constitution, state rights, personal rights, etc., tend to become of 
less importance in political discussion; while labor, corporations, 
and foreign relations tend to become of more importance ; still other 
problems like public finance, commerce, and defence about hold 
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their own; health, industry, and justice appear to be gaining in 
importance; all topics of discussion are fundamentally affected 
by the two general trends which the writer believes he discovers 
beneath the surface of our national life the trend toward 
more efficient nationalism and toward more complete democracy, 
through the socialization of industry and the democratization of 
parties. 

7. From all that has gone before, it is safe to assume that 
any course of instruction whose purpose is to prepare for intelli- 
gent suffrage through the exercise of civic judgments upon con- 
crete problems should contain at least the following topics : finance 

federal, state, municipal, and school district; office, elections, 

civil service, etc., including the related topics of parties and 
suffrage as applied to the locality; corporations; labor; foreign re- 
lations, including relations to defence and commerce; natural re- 
sources, conservation and reclamation; monetary system money, 
banking, and credit; and the present moral issues of nation, state, 
and community. 

8. Recognizing with Professor Keatinge of Oxford (Studies 
in Education) , that grave difficulties lie in the way of any adequate 
treatment of politics in the public school, but likewise recognizing 
with him the necessity of such preparation in an increasingly dem- 
ocratic state, the writer believes such instruction is feasible and nec- 
essary. The following quotation expresses Ms view of the need: 
* ' To any one who considers that the final decision as to policy and 
legislation of every kind, imperial, financial, and social, is made, 
theoretically at any rate, by the mass of individual voters, to any 
one who considers further that the number of male voters is in the 
near future sure to be largely increased and that probably there 
will be added to them a large number of female voters, there can 
be little doubt that an important duty of our schools is to give a 
training which shall enable our children, as they grow up, to take 
an intelligent interest in political life, and to register their votes 
when the time comes for them to do so in connection with some in- 
telligible body of principles." 



CHAPTER VIII 

THE HISTORICAL INFORMATION ESSENTIAL FOR THE 
INTELLIGENT UNDERSTANDING OF CIVIC PROBLEMS 



B. B. BASSETT 
State University of Iowa 



OBJECT 

The present study is an outgrowth, of the study reported by 
Horn in the Sixteenth Yearbook of this Society, Chapter X. Horn 
sought to discover what history is most needed for the intelligent 
understanding of modern problems, conditions and activities. The 
present investigation is more limited in scope. It seeks to discover 
what history is most necessary to the intelligent understanding of 
modern political problems, conditions and activities. As in the case 
of the former study, no brief is held for this or any purpose as the 
one which should determine the content of the history curriculum. 

METHOD 

The investigation was undertaken with the same hypothesis 
as that used by Dr. Horn, viz.: "that if a representative list of 
the more crucial modern problems could be secured, and if among 
the books dealing with each problem, those be selected which give 
the clearest statement of that problem, it might be expected that 
these books would contain at least the sort of history, or amount of 
historical reference which in the judgment of the authors is essen- 
tial to a proper understanding of the modern problems they are 
discussing. ' ' 

Accordingly, members of the staff in the Department of Polit- 
ical Science of the State University of Iowa were asked to make a 
list of crucial present-day political problems and to indicate a 
book dealing in a representative manner with each of these prob- 
lems. Books which dealt primarily with local conditions, and also 

81 
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"books which, were plainly historical were barred from consideration. 
The following list of twenty-two books was chosen as a basis 
of the study : 

1. Adams Science of Finance. (Taxation) 

2. Bolen Plain Facts as to the Trust and the Tariff, Pt. II. 

3. Brawn Transportation Sates and their Regulation. 

4. CMlds -The Short Ballot Principle. 

5. Committee of Fifty The Liquor Problem 

6. Commons Proportional Representation 

7. FaireMld Immigration 

8. Groodnow Administrative Law 

9. HaU Outline of International Law 

10. Haynes- Child Lai or 

11. Hunter Poverty (Poor Belief) 

12. Jenks The Trust Problem 

13. Jones Statute Law-Making 

14. Mathews Woman Suffrage 

15. Mullen The A. . C. of National Defense 

16. Munro Municipal Government 

17. Bav Political Parties and Practical Polities 

18. Beinseli Readings on American Government (Civil Service) 

19. Byan A Living Wage (Minimum Wage) 

20. Seager Social Insurance 

21. Taft Popular G-owernmen-t (Initiative, Beferendum) 

22. Report Relative to Legislative Reference Bureaus by librarian of 
Congress in Senate* Do>cuments, 62nd Congress, 1st Session, No. 7 

To supplement the data secured from these boots, twenty-two 
articles, corresponding in subject matter with, the material found in 
eaeh of the several books, were checked in the Cyclopedia of Amer- 
ican Government. The data thus obtained were compiled separately 
and are frequently compared with those from the books. 

In analyzing the material, both in the books and in the cyclo- 
pedia articles, an attempt was made to secure the following classes 
of data: (1) the historical characters referred to in each book; 
(2) specific dates, and the frequency of reference to the various per- 
iods in history; 1 (3) the frequency of reference to the leading for- 
eign countries; and (4) historical movements, events, conditions 
and problems. 

In analyzing the material of this last class an outline given by 
Albion W. Small in his General Sociology was used as a basis 1 . Ac- 
cording to Mr. Small's presentation, there are six general heads 
under which the efforts and! activities of man may be grouped, viz : 

*For periods prior to 1860, the classification was made to correspond to 
that followed by Dr. Horn in his study in the Sixteenth "Yearbook. Following 
the date 1860, ten-year periods were used. 
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I. AcMevements for tlie Protection of Health.. 

II. AcMevements for the Promotion of Wealth. 

III. AcMevements in Harmonizing Human Eelations. 

A. Political AcMevements. 

B. Industrial and Property Interests. 

C. Opportunities for Culture. 

IV. AeMevements in Discovery and Spread of Knowledge. 
Y. Achievements in Fine Arts. 

VI. AeMevements in Eeligion. 

Under each, of these main headings Mr. Small indicates a large 
number of topics and sub-topics. "While it was not found advisable 
to use these sub-topics in tabulating tne data from the books and 
the encyclopedia, they were of use? in interpreting the headings. 

In checking and classifying these Mstorieal data, the follow- 
ing rules and regulations were observed : 

(1) Score only those references that are clearly historical. 

(2) In case of Mstorieal movements, events and problems, 
indicate them in the specific terms of the author, and place the ref- 
erence under the main section of tne outline where it seems most 
logically to belong. In ease the reference clearly has a double sig- 
nificance it may be checked under two headings, as, for example, 
under " Protection of Health' 7 and under "AcMevements in Har- 
monizing Human Eelations." 2 

(3) Score any given item but once in a single paragraph.. 

(4) Dates in parentheses are not to be checked. 

The analysis of a single paragraph may serve further to il- 
lustrate the classes of data' desired, and the method used in check- 
ing the material. The following paragraphs taken from a contem- 
porary writer upon "Equal Suffrage " will serve as the basis of this 
analysis. 

"The movement for equal suffrage may be said to have begun 
in England toward the close of the eighteenth century. In 1792 
Mary "Wollstonecraft published a book on the Viitidication o/ fke 
Rights of Women wMch, though greeted with a storm of ridicule 
and abuse, gave the first considerable impulse to a discussion on the 
subject. In 1797 Charles Fox is quoted as saying that all the su- 
perior classes of the female sex in England must be more capable of 

2 A legislative measure dealing with health regulations, or one providing 
for the use of safety devices might fall thus under two headings. 
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exercising the elective suffrage with deliberation and propriety than 
the uninformed individuals of the lowest class of men to whom the 
advocates of universal suffrage would extend it. Bentham likewise 
remarked upon the injustice of refusing women the right to vote. 
In 1835 Bailey strongly advocated the extension of the suffrage to 
women in his treatise entitled Tlie Rationale of Political Represen- 
tation. Likewise, Benjamin Disraeli in 1848 declared in the House 
of Commons that he saw no reason for denying women the right 
to vote. But the most influential advocate of equal suffrage in 
England was John Stuart Mill, who espoused the cause with great 
power in Ms book on The Subjugation of Women, published in 1869. 
Moreover, in 1867 Mill championed the cause of equal suffrage in 
the House of Commons by proposing it as an amendment to the 
Reform Bill then pending." 

The specific items of historic interest in this paragraph are 
(1) Equal Suffrage, a subject to be classified under "Achievements 
in Harmonizing Human Relations;" (2) the Reform Bill, likewise 
under "Achievements in Harmonizing Human Relations," and (3) 
England, to be placed under "Leading Foreign Countries. ' ' Equal 
suffrage is mentioned three times, but since it is within a single 
paragraph, the subject is checked only once. England is mentioned 
twice, but is checked once. 

The specific dates occurring in this paragraph are 1792, 1797, 
1835, 1848, 1867, 1869. The general period of the eighteenth cen- 
tury is also mentioned. 

The historical characters mentioned are Bailey, Bentham, Ben- 
jamin Disraeli, Charles Fox, John Stuart Mill, and Mary "Woll- 
stonecroft. Each of these persons is checked once, notwithstanding 
the fact that Mill's name appears twice. 

RESULTS 

Persons. In analyzing the twenty-two books, a total of 563 
names was found. Of this list many appeared but once ; others ap- 
peared several times but in connection with a single subject. Twen- 
ty-three of the names appeared in connection with at least three 
subjects. These names are as follows : 
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TABLE I 
REFERENCES TO PERSONS IN TWENTY-TWO BOOKS 







Different 3 


lumber of times 








Problems 


mentioned 


Product 


1. 


Roosevelt, Pres 


10 


25 


250 


2. 


Cleveland, Pres 


7 


9 


63 


3. 


Smith, Adam 


5 


11 


55 


4. 


McKinley, Pres 


5 


9 


45 


5. 


Taft, Pres. . . . 


4 


11 


44 


6. 


Jackson, Pres 


4 


11 


44 


7. 


Grant, Pres 


5 


8 


40 


8. 


Mill, John Stuart 


5 


8 


40 


9. 


Wilson, Pres 


6 


6 


36 


10. 


G-arfield, Pres 


4 


8 


32 


11. 


Malthus , 


4 


8 


32 


12. 


Montesquieu 


3 


7 


21 


13. 


Eliot, Charles W. 


4 


4 


16 


14. 


Hamilton, Alexander 


4 


4 


16 


15. 


Harrison, Pres. W. H 


3 


5 


15 


16. 


Walker, Francis 


3 


5 


15 


17. 


Hughes, Charles Evans 


3 


4 


12 


18. 


Lincoln 


3 


4 


12 


19. 


Bryce, James 


3 


3 


9 


20. 


Clay, Henry 


3 


3 


9 


21. 


Cobden, Richard 


3 


3 


9 


22. 


List, Frederick 


3 


3 


9 


23. 


Washington, Pres 


3 


3 


9 



In analyzing tlie twenty-two articles in the Cyclopedia of Amer- 
ican Government, seventy-nine names were found. Only five of 
these names, however, were found in connection with more than 
one subject. The names ranking highest in these articles are shown 
in Table II. 

TABLE n 

REFERENCES TO PERSONS IN TWENTY-TWO CYCLOPEDIA ARTICLES 



Number of times 
Articles mentioned Product 



_ _ 

Cleveland ................................. 4 6 24 

Taft ..................................... 4 6 24 

Roosevelt ................................. 3 4 12 

Wilson ................................... 2 5 10 

Wright, Francis ............... > ........... 2 _ 2 _ 4 

Thus this, like previous studies, seems to indicate that in dis- 
cussing modern civic problems authors refer more frequently to the 
names of presidents than to any other group. Six of the names 
Cleveland, McKinley, Jackson, Grant, Lincoln, and Clay are found 
among the list obtained in a similar study by the graduate students 
of the University of Illinois. Moreover, five of the names, Eoose- 
velt, Adam Smith, John Stuart Mill, Malthus, and Wilson, occur in 
the list obtained by Horn. On the other hand, it will be observed 
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that the list varies widely from that presented in Bagley's "Hall of 
Fame," in which the names were derived from current textbooks 
in elementary American Mstory. 

Dates. In the books analyzed, 214 dates were found, and in 
the Cylopedia of American Government 89, a total of 221, many of 
which appeared but once. The following twenty dates, eighteen 
of which are in the period since 1890, appear most frequently : 

TABLE in 

REFERENCES TO DATES IN BOOKS AND CYCLOPEDIA ARTICLES! COMBINED 



Date 


Different 
Problems 


Times 
Mentioned 


1882 


9 


34 


1887 


14 


34 


1890 


20 


66 


1893 


14 


33 


1894 


14 


54 


1896 


13 


43 


1897 


17 


53 


1898 


16 


41 


1899 


11 


35 


1900 


18 


73 


1901 


21 


41 


1903 


15 


36 


1904 


11 


87 


1906 


10 


33 


1907 


18 


61 


1908 


18 


71 


1909 


12 


45 


1910 


17 


78 


1911 


14 


35 


1912 


19 


69 



Eecent dates obviously appear much more often in discussion 
of these modern political problems than do dates more remote. 
Moreover, the dates commonly required in the study of history, and 
those recommended by the members of the American Historical 
Association, are not frequently referred to. The date 1492 was 
found but once, and that in connection with the problem of immi- 
gration. In like manner, the date 1607 appeared but once, and 
1812 but six times, while 1765, and April 14th, 1861, were not found 
in any of the books or articles. Morel than 90 percent of the dates 
mentioned were subsequent to 1812, while (see Table IV) in current 
textbooks in elementary history less than 46 percent of the space is 
devoted to this period. The contrast is even greater if limited to the 
period since 1860. 
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Historical Periods. A study of the frequency of reference in 
these books and articles to historical periods indicates that in dis- 
cussing modern problems, authors refer frequently to recent peri- 
ods, whereas in the elementary texts much attention is given to more 
remote periods. The data for American History from the present 
study are summarized in the table below, along with the data from 
the studies by Horn, and by Bagley and Rugg. In the latter study 
the data are those for textbooks published between 1904 and 1812. 

TABLE TV 
HISTORICAL BEFEBENCES CLASSIFIED BY PERIODS 



Period 


o Horn 
International 
Books Cyclopedia 


Bagley & Rugg 
Elementary 
Texts 


Present worfc 


Unclassified 




3.7 
0.67 
2.0 
3.5 
6.0 
11.0 
74.0 


8.27 
19.62 
13.69 
14.17 
21.00 
24.67 


0.93 

2.46 
1.72 
4.3S 
16.39 

74.12 


Disc, and Exploration 


...... 0.1 


Col to 1764 , 


2.5 


1764-1783 .... 


3.8 


1783-1812 


18 


1812-1861 . 


, 4.7 


1861-1916 


5.7 



The analysis of the period from 1861 to 1916 as found in the 
present investigation, follows in Table V : 

TABLE v 

BEFEBENOES TO MODERN PEBIOD FUBTHER ANALYZED 

p erio Percentage of references to 

Each Period 

1860-1870 3.58 

1870-1880 7.04 

1880-1890 10.53 

1890-1900 20.53 

1900-1910 22.17 

1910-1917 10.27 



Total since 1860 74.12 



The frequency of reference to foreign countries, as found in 
this study, corresponds closely to the results obtained in the study 
by Horn. He reports that the countries most frequently mentioned 
are England, Germany, France and Russia. The present study 
shows that in a discussion of modern civic problems authors refer 
to England more than twice as often as to any other foreign country ; 
Germany ranks second and France third. 

The portion of the study which has to do with the various 
phases of history as a background for civic problems is still incom- 
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plete, but the data so far gathered seem to suggest certain con- 
clusions. In discussing modern civic problems the authors we have 
examined make very few references which could be classified under 
"Achievements in Discovery and Spread of Knowledge," "in Fine 
Arts'" 01- "in Religion." Especially is this true of "Fine Arts/' 
which are scarcely mentioned in any of the books or articles an- 
alyzed. Under "Achievements for the Protection of Health," 
a few topics clearly receive the most frequent mention. 
Among these are sanitation, care of the sick, pure food, 
improved safety devices, health regulations in factories, and 
recreation. In connection with "Achievements for the Pro- 
motion of Wealth," the chief topics of discussion are trade 
and commerce, manufacturing, agriculture, transportation, wages, 
and labor. By far the greater number of historical movements and 
events are classified under "Achievements in Harmonizing Human 
Relations." The subject that receives the most frequent mention 
is legislation federal, state, and foreign. The specific topics most 
frequently mentioned are: Tariff, Municipal Government, Political 
Parties; Boards, Bureaus and Commissions; Civil Service, Elec- 
tions, the Federal Constitution, Eeferendum, Initiative, Short Bal- 
lot, Taxation, Transportation, and Poor Belief. Referring back to 
the list previously given of the titles of books included in this study, 
it will be seen that each one of these topics (with the sole exceptions 
of the Federal Constitution, and Elections) is specifically the sub- 
ject of -one of the books included. Nine of the twenty-two books are 
thus represented: this may mean that these nine books are more 
important than the rest, or merely that they are longer. Thus, 
this last list, though apparently significant, conceivably has very 
little meaning. 

An investigation of this sort cannot, of course, prescribe the 
details of a course of study. But in general, the indications seem 
to be that, aside from the names of presidents, those of economists 
are the names with which a student of modern political problems 
needs to be familiar; that a knowledge of recent dates (especially 
since 1890) and of the recent period in American history (again 
especially since 1890, for 53 percent of all references to periods be- 
long to this one) , together with a knowledge of the Federal Consti- 
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tution, Is tliat American historical knowledge wMcli is for him 
the most illuminating; and that of foreign lands, England out- 
weighs all the rest in contributions towards the problems he has 
to solve. 3 In conclusion it may be well to repeat that this study has 
not aimed to consider the historical background of any other than 
this political phase of modern life. 



*This apparent importance of England may however be due to our com- 
mon language. Works in other languages are on the whole much less accessi- 
ble to such authors as wrote the books in question. 



CHAPTER IX 

A METHOD OF DETERMINING- MISPLACEMENTS OF EM- 
PHASIS IN SEVENTH AND EIGHTH-GRADE HISTOEY 



L. E. MABSTON, H. G. MeKOWST AISTD W. 0. BAGKLEY 

(A study made at the School of Education, University of Illinois.) 



INTRODUCTION 

The report on minimal essentials in American history which 
appeared in the Sixteenth Yearbook attempted to state present-day 
minimal essentials as determined by an analysis of textbooks used 
in the seventh and eighth grades and by the recommendations of 
the Committee of Eight of the American Historical Association. 
The data regarding the textbooks were summarized from a detailed 
study of twenty-five texts, 1 the results of which were published as 
Bulletin No. 16 of the School of Education, University of Illinois. 
Both the original study and the summarized report emphasized the 
fact that this method could determine only what the minimal essen- 
tials are as the subject has been taught in the past and as it is taught 
today. It cannot determine what these essentials should be, al- 
though it may trace the changes that have been taking place and 
consequently reveal tendencies. ,The study in question, for example, 
disclosed significant tendencies (as, for example, the lessening em- 
phasis upon military affairs during the past three decades) which 
are doubtless symptomatic of changing ideals as to the aims that the 
elementary teaching of history should seek to realize. 

The study reported herewith attempts to determine more pre- 
cisely some of the misplacements of emphasis in the present-day 
and relatively recent teaching of elementary history. In order to 
make this determination, certain criteria must be selected against 
which to measure present practices. As permitting application to 



of these textbooks were published prior to 1890; nine were pub- 
lished between 1902 and 1912. 

90 
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the textbooks used in tlie seventh, and eighth grades, the following 
criteria were chosen : 

(1) Are the relative emphases given to events in the text- 
books consistent with the emphases given to the same events in 
standard books of reference! 

(2) Are the relative emphases given by the textbooks con- 
sistent with the judgment of students of history regarding the 
events that should be emphasized! 

(3) Are the relative emphases given by the textbooks con- 
sistent with the need for historical knowledge in interpreting cur- 
rent discussions of national problems as these are revealed in peri- 
odical literature? 

To subject the content of the courses in history taught in the 
elementary schools to these and other desirable criteria is something 
that should be done. Indeed, when one reflects upon the funda- 
mental bearing of universal elementary education on our national 
life, it is inconceivable that the actual content of instruction in any 
subject of study should be permitted to escape the closest possible 
scrutiny and evaluation by means of impartial and objective meth- 
ods, which are themselves susceptible of scientific control and eval- 
uation. To make such an examination of all the materials now 
comprising the content of elementary history, however, would in- 
volve an expenditure of time and money out of the question in 
connection with the present study. All that could be done here, 
as in the investigations of history-materials reported in the Four- 
teenth Yearbook and in the Sixteenth Yearbook, was to explore a 
very limited area of the field for the purpose primarily of testing 
a method of procedure. 

The study was consequently limited to one type of textbook 
materials the names of persons that are given prominence by 
twenty-five elementary textbooks in their treatment of the period 
of American history between the years of 1765 and 1865. These 
are listed in the Bulletin above referred to under the caption "The 
Hall of Fame/' Two lists are given, one comprising the twenty-five 
names most frequently mentioned in the textbooks as prominent 
in the events of civil life, the other comprising the twenty-five 
names most frequently mentioned as prominent in military and 
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naval affairs. In each case the names are listed in the order of 
frequency and tMs order consequently forms an index of the rela- 
tive emphasis accorded by the textbooks to the persons named, and 
more indirectly to the events with which the names are associated. 
As was pointed out in the original study, the personal or concretely 
human elements are especially important and formative in the study 
of history by children and young adolescents ; the lasting associa- 
tions cluster about names rather than about the more abstract, 
more impersonal events and movements; consequently it is fair to 
assume that misplacements of emphasis here will be symptomatic 
of other and conceivably more fundamental distortions. 

METHOD 

The two lists of names presented in the Bulletin as constitut- 
ing the textbooks' "Hall of Fame 5 ' may be considered as ' ratings' 
of the importance of persons named as figures in American history. 
To test the validity of these ratings, three other types of ratings 
of the same men were secured, each type representing one of the 
criteria referred to above : 

(1) The "Encyclopedia Ratings." The following encyclo- 
pedias and dictionaries of biography formed the basis of this part 
of the study. 

For "both cwil and military lists : 

The Universal Cyclopedia and Atlas 

TTie Encyclopedia 'Britannica 

Appleton's Cyclopedia of American Biography 

The *New International Cyclopedia 

Drake's Dictionary of American Biography 

Harper's Encyclopedia of American History 

For the civil list only: 

Lamb's Biographical Dictionary of the United States 
National Encyclopedia of United States History 

The method here was to determine the amount of space devoted 
to each person in the text that appeared under his name, and to 
arrange the names in the order of the total amount of space each 
received. Four men found a place in both lists; consequently, each 
of these four names was credited in the civil list only with the 
amount of space devoted to him as a participant in civil affairs, 
and credit in the military list was similarly limited. 
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(2) TJie "Historians' Ratings." The two lists of names were 
sent to 205 teachers and students of history In American schools 
and universities. The names in each list were arranged in alpha- 
betical order and a ranking of these names in the order of their 
"relative importance in American history" was requested. Sev- 
enty replies were received, of which, however, only thirty-three 
could be used. 

(3) TJie "Magazines 9 Ratings." In order to determine 
whether the relative emphasis given to the persons named in the 
textbooks bore a definite relation to the need for information con- 
cerning these persons in interpreting current discussions, 'samp- 
lings' from the files of four magazines covering a period of ten 
years (1904-1913, inclusive) were read, and two lists representing 
the frequencies of mention were constructed. The samplings were 
distributed over the ten years in such a way that each year was rep- 
resented by approximately the same number of issues. References 
to the four names appearing in both civil and military lists were 
treated separately, as in the case of the encyclopedia ratings. Each 
name was credited with one reference only for each article in which 
it appeared. The magazines and the number of issues of each that 
were read were as follows : 

Atlantic Monthly 20 issues 

The Nation 78 issues 

Colliers 38 issues 

Saturday Evening Post 20 issues 

In the tables that follow, the frequencies of reference in all of 
the magazines are combined. 2 

RESULTS AND INTERPRETATIONS 

The accompanying tables show the comparisons and correla- 
tions of the several rankings, together with the significant dis- 
placements of the textbooks' rankings as compared with the other 
rankings. In determining these displacements, all of the rankings 
(including those of the textbooks) were combined by adding the 
rankings for each name and arranging the names in order from the 

3 In the magazines that were examined, seven of the fifty names that 
appear in the textbooks' lists were not mentioned: Samuel Adams in the civil 
list, and Thomas, Howe, Sehuyler, Harrison, Early, and Gage in the military 
list. These were given the lowest place in the two magazine rankings. 
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lowest to tke highest total The lists as presented herewith are 
given in the order of these 'amalgamated rankings.' 

It is especially noteworthy that the several rankings of men 
prominent in political life are in general nracli more highly correl- 
ated with one another than are the rankings of men prominent in 
military life. The textbooks' rankings show particularly low cor- 
relations with the other rankings in the military list, and this adds 
confirmation to the general opinion that the textbooks have tended 
to distort military history. More specifically, the traditional treat- 
ment of our wars by the textbooks has apparently underemphasized 
the achievements of the navy, and given too large a prominence to 
the British generals in the War of the Revolution. 

The textbooks' apparent misplacements of emphasis in the 
treatment of political affairs, in so far as a study of this type is com- 
petent to reveal such misplacements, are less numerous and less 
wide. It is significant, however, that in all probability, the text- 
books have not done full justice to Franklin, Webster, and Jefferson 
Davis. 

The names that should in justice be added to these two lists are 
fewer than one would expect, if the suggestions from historians 
and magazines are an index. The textbooks that are used in the 
seventh and eighth grades have always emphasized the political and 
military history of the nation, and with changing conceptions of 
the functions of this elementary study of history, it is altogether 
probable that other names will come to replace those that have been, 
and are being given the positions of prominence. The following 
names not included among the twenty-five most frequently men- 
tioned by the textbooks were suggested by two or more historians 
or indicated by ratings from The Nation : 



TABLE I 

POSSIBLE ADDITION'S TO NAMES EMPHASIZED 



ELEMENTARY TEXTBOOKS 



From Historians 


To Civil list 


To Military list 


Seward 


8 mentions 


John Paul Jones 4 mentions 


Marshall 


6 




Chase 


4 






3 




Garrison 


.8 






.2 




.0 


C. F. Adams 


.2 




From The Nation 


To Civil List 




To Military I/ist 


Marshall 
Setvard 
Chase 
Otis 


A. 8. Johnston 
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TABLE H 

RATINGS OF MEN PROMINENT IK CIVIL. LIFE BETWEEN 1765 AND 1865 



Names 


Banking according to 


"o 


H 

<1P3 


ii 

10 
Cl,fi 


4 

Is 

o-S 

o 

CO j=k 


1 

s a 

.s 

CO S 


h 

-#*3 




1 
2.5 
2.5 

4 

5 
6 
7.5 
7.5 

9 
10 
11 
12 

13 
14 
15 
16 

17 
18 
19 
20 

21 
22 
23.5 
23.5 
25 


1 

2 
3 
10.5 

4 
7 
8 
14 

5 
9 
6 

10.5 I 

14 
20.5 
16.5 

18.5 

14 
12 
16.5 
18.5 

20.5 
24.5 
22.5 
24.5 
22.5 


1 

4 
2 
3 

8 
5 

10 

7 

6 
9 
11 
12 

14 
15 
20 
13 

22 
21 
18 
19 

16 
23 
24 
17 
25 


2 
1 
3 
6 

8 
4 
9 
5 

11 
12 

7 
17 

10 
18 
15 
21 

20 
16 
13 
22 

19 
14 
25 
24 
23 


1 
3 

2 
4 

5 
9.5 
6 

7 

12.5 
9.5 
17 
S 

17 
11 
14.5 
14.5 

12.5 
23 
25 
20 

19 
23 
17 
23 
21 






































Tyi er 


"Polk 






"W H Harrison . ... 


Taylor . . . . 



TABLE HI 
CORRELATIONS OF RANKINGS (CIVIL LOCST) 





Text- 
books 


Encyclo- 
pedias 


Histo- 
rians 


Combined 
Magazines 


Textbooks 




81 


81 


75 


Encyclopedias 


81 




80 


83 




81 


SO 




69 


Combined Magazines ... . 


75 


83 


69 




Average 


79 


81.3 


76.7 


75.7 



TABLE IV 

DISPLACEMENT OF TEXTBOOKS' CIVIL Ri^TKINGS OF FOUR PLACES OR 
MORE FROM AMALGAMATED RANKINGS 



A. Textbooks apparently overemphasize the importance of Displacement 

Patrick Henry 6 places 

Madison 5 " 

John Adams , 4 " 

B. Textbooks apparently under emphasize the importance of 

Franklin 

Webster , 

Jefferson Davis , 



.6.5 places 
.6.5 " 
.6.5 " 
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TABLE V 

RANKINGS OF MEN PROMINENT IN MILITARY AND NAVAL AFFAIRS BETWEEN 

1765 AND 1865 



Names 


Ranking according to 


1 
! 

33 

41 


too 
M 

U3 

csija 


4 

P 
"g 

O P< 


3 1 

CO .* 
CO h 


& 

l| 

Tft'S 


Grant 


1 
2 
3 
4 

5 
6 

7 
8 

9 

10.5 
10.5 
12 

13 
14 
15 
16 

17 
18.5 
18.5 
20 

21 
22 
23 
24 
25 


3 
1 
2 

4 

6 
12.5 
9 
12.5 

17 
23.5 
14.5 

7 

5 
23.5 
11 
23.5 

14.5 
23.5 
10 
18 

8 
19 
23.5 

20.5 
20.5 


1 
4 
3 
2 

7 
10 
5 
6.5 

13 

9 
11 
15 

14 
6.5 
18.5 
21 

12 
18.5 
18.5 
20 

24 
16 
18.5 
23 
23 


3 

4 

8 
5 

19 

7 

9 
11 
10 
12 

16 
6 
17 
14 

15 
18 
17 
13 

21 
23 
18 
25 
25 


3 
2 
6.5 

4.5 
8 
11 
18.5 

9.5 
6.5 
14,5 
18.5 

18.5 
23 
13 
4.5 

23 
9.5 
13 
23 

-23 
23 
23 
23 
23 










otoneivaii 


r*r ne 


. 











FarrfteTif " ' 


n frnyn A * 


Meade 


















Gage 



TABLE VI 
CORRELATION OF THE RANKINGS (MILITARY LIST) 





Text- 
books 


Encyclo- 
pedias 


Histo- 
rians 


Combined 
Magazines 






55 


57 


36 




55 




83 


55 




57 


S3 




61 


Combined Magazines - - . 
Average 


36 
49.3 


55 
64.3 


61 

67 


50.7 



TABLE VII 

DISPLACEMENTS OF TEXTBOOKS' MILITARY RANKINGS OF FOUR PLACES OR 
MORE FROM AMALGAMATED RANKINGS 

A. Textbooks) apparently overemphasize the importance of Displacement 

Howe ........................................... 13 Places 

Clinton .......................................... 8.5 j} 

Cornwallis ....................................... 8 

J. 32. Johnston .................................... 5 

Burgoyne . . . . .................................... <* 

B. Textbooks apparently under emphasize the importance of 

A. Jackson ....................................... 13 places 
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SECTION U 

A SYMPOSIUM ON THE PURPOSES OP HISTORICAL 
INSTRUCTION IN THE SEVENTH AND EIGHTH-GRADES 



By J. Q. Dealey, C. A. Ellwood, E. B. Greene, A. B. Hart, W. EL Mace, David 

Sneddan and an Anonymous Contributor 
Introduction and Summary "by W. CL Bagley 



INTRODUCTION 

Studies of minimal essentials in American history have ap- 
peared in the reports of the Committee on Economy of Time pre- 
sented in the Fourteenth Yearbook and Sixteenth Yearbook of this 
Society. These studies have hitherto been limited to problems that 
were susceptible of empirical treatment, and have been concerned 
chiefly (1) with the actual content of seventh-grade and eighth- 
grade instruction in American history as this is revealed in the 
textbooks, and (2) with possible deficiencies in the present-day con- 
tent as these are revealed by the demands which current literature 
of various types may be assumed to make upon the historical in- 
formation of its readers. 

The symposium presented in the following pages attacks the 
problem of minimal essentials in history from a quite different 
point of view. It represents an attempt to formulate aims or ob- 
jectives for the teaching of elementary history, and to evaluate 
current aims and objectives. Not what is but what ought to "be is 
the point at issue here and not "what ought to be" as determined 
by a circumscribed examination of a particular need (such as the 
need for historical information in interpreting current literature), 
but "what ought to be" from the point of view of realizing na- 
tional ideals. 

In arranging for this symposium, a letter was sent to twelve 
men: one philosopher; four historians prominent in the field of 
American history; two sociologists; two specialists in the teaching 
of history ; one professional student of education whose chief inter- 
est is in the sociological foundations of education ; one superintend- 
ent of schools who is also a student of history; and one business 
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man wlio lias been interested in the influence of elementary Mstory 
upon national ideals. 

The seven contributions printed herewith were received in 
response to this letter,, the essential parts of which follow : 

''The Committee of the Department of Superantendence on Economy of 
Time in Elementary Education has asked me to organize a symposium on the 
possibilities and present weaknesses of the instruction in American history 
now given in the upper grades of the elementary school. In view of the large 
influence that this initial study of our country's history must have in shaping 
our national ideals, the committee believes that the time is opportune for a 
thorough-going discussion of the aims and objectives that should govern the 
content and the spirit of the instruction. As at present constituted, the ele- 
mentary work in history is generally regarded as having for its purpose the 
development of "good citizenship " and especially the inculcation of patri- 
otism. It has been and is still concerned primarily with our political and mili- 
tary history, although there has been a tendency in the past two decades 
to give a larger emphasis to social, industrial, and economic development. 
The question in the "minds of the members of the committee is whether the 
bearing of this elementary study of the national history upon good citizenship 
cannot be more adequately defined. "What specifically should this basic work 
attempt to accomplish and what changes in the content and spirit of the in- 
struction are essential if the desired ends are to be attained f ' ' 
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J. Q. DEALEY 
Professor of Social and Political Science, BroTsn University 



In tMs symposium my Interest is concerned more with, the 
"possibilities" than with the "weaknesses" of the instruction in 
American history now given in the upper grades of the elementary 
schools. Believing thoroughly, as I do, in the need for a greater 
" economy of time in education/' I would yet stress as of equal, 
if not greater importance the need of real efficiency in teaching. 
Furthermore, instruction in the grades presumably can be given 
more effectively if the work of instruction and the content of the 
subject matter are both brought into relation with the larger edu- 
cation of the secondary schools and the college. 

I would therefore venture to suggest that efficiency in the 
teaching of history and economy of time in the grades depend 
largely (1) on the personality and intelligence of teachers, and (2) 
on the freedom and initiative allowed these in determining the 
methods they use and the content of the subject matter they im- 
part, provided that there is a general understanding among the 
teachers of history as to the end to be attained through the instruc- 
tion they furnish. 

In respect to the first point I should assume that in general 
the average teacher at present in the grades, through lack of a broad 
education, is incompetent to give capable instruction in history. 
In place of these, those responsible for city or county systems of 
instruction should select a well-trained capable person and place 
Mm in charge of the teaching of history. This person should be al- 
lowed a voice in the selection of his assistants and should be held 
responsible for the efficient presentation of history in all the sec- 
ondary and graded schools of the city or county. Assistants should 
invariably be graduates of colleges, preferably with some training 
in education, and the importance of their work should be shown 
by the payment of proper salaries. The several heads of instruc- 
tion in history within a given state, in connection with an advisory 
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committee selected from the departments of history, economics, 
politics, and sociology of neighboring colleges or universities, should 
be required to meet monthly or bimonthly for purposes of discus- 
sion in respect to problems of teaching, both as to content and 
as to method. Under some such system as this the importance of 
the teaching of history would be emphasized and instructors would 
be stimulated to 'make good/ so as to win reputations as capable 
teachers, and consequent promotion. 

As to the second point, it would seem unwise to require cap- 
able and intelligent teachers to confine themselves to stipulated 
textbooks, or to routine methods of instruction. An intelligent 
teacher of good personality is a better source of instruction than 
nine tenths of the textbooks now in use. In the classes in history 
it might be well for instructors occasionally to prepare simple lec- 
tures on the subject matter, so as to train the ear of the pupil 
as well as the eye, and also to begin instruction in the taking of 
notes from lectures and from a minimum of carefully selected read- 
ings. History in this social age should no longer be confined pri- 
marily to political and military history, but should include the 
essentials of social evolution, stressing the development of man 
and his achievements, in addition to the development of the nation. 
In this transitional century of world history, teachers should be 
allowed large discretion in method and content, so as to allow a 
varying emphasis according as social, economic, national, or inter- 
national interests are uppermost in men's thoughts. The pupils 
of course must master the important details of civic organization, 
structure, and function, but the real object of each teacher should 
be to arouse interest in the larger affairs of national and interna- 
tional life as well as in the activities of local environment. In 
addition, he should aim to explain to his pupils the inter-relation- 
ships of human society, to develop an appreciation of the social and 
political ideals of progressive nations, especially those on the West- 
ern Continent, and, as an aid in this, to have them become familiar 
with the names and lives of great achievers in national and social 
progress. He should also be able to explain, as opportunity offers, 
the importance of some past or new invention or scientific discov- 
ery, or some great achievement in national culture. Especially 
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should lie be capable of explaining simply tlie principles of Amer- 
ican democracy, suck as those underlying a federation, the written 
constitution, the party system, and a citizen's rights and obliga- 
tions. Obviously, instruction in the grades must be simpler than 
in secondary schools, yet the distinction should be chiefly in quan- 
tity, not in quality ; for, after all, the finest and best of human knowl- 
edge can be comprehended by children, as easily as by adults. 
Since relatively so few children pass from the grades to higher 
education, it is surely the height of absurdity for 1 a nation to allow 
the great mass of its future citizens to enter economic life without 
a gleam of national hope and aspiration. Probably if interest in 
such matters were aroused in graded schools, a far larger number 
would enter the schools of higher education, so as to become familiar 
with the movement of national and international politics and with 
the steps in social progress. 
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CHARLES A. 
Professor of Sociology, University of Missouri 

In my opinion the aim of teaching American history in the 
elementary schools should always be "good citizenship." This, to 
be sure, should be the general aim of the whole curriculum, but 
in the teaching of the social studies, such as our national history, 
it should be especially emphasized. I mean by "good citizenship" 
not simply the making of intelligent voters, desirable as that may 
be, but the fitness of the individual for community and national 
service on the broadest human lines. I should hold it to be es- 
sential to good citizenship, for example, that the individual be a 
good friend and neighbor, a good father or mother, an efficient pro- 
ducer and a wise spender, as well as loyal to his country. To be a 
good citizen, in other words, one must share fully in the national 
consciousness, that is, in the ideas and ideals which have guided 
the past development of our nation and which we set up as the 
goals of its future development. 

I should deprecate the teaching of 'patriotism' in any formal 
sense in the study of American history. Eather, the child should 
be taught loyalty to the great ideals for which our nation has stood ; 
patriotism will then take care of itself. Our whole national history 
should be presented to the child as a struggle to realize certain 
national ideals. The child should be taught to look upon American 
history as a movement to realize an ideal society founded upon ideas 
of liberty, justice, and brotherhood ; to appreciate that the failure 
of our nation to realize these ideals would mean an irreparable loss 
to humanity as a whole; and finally to feel that on this account 
the great lesson for the individual to draw from American history 
is that he should consecrate himself and all of his powers to the 
realization of these ideals. 

The study of human culture has shown us that all cultural and 
group life develops about certain 'pattern ideas.' These 'pattern 
ideas' in American history may be briefly summed as those of 'dem- 
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ocracy,' ' national unity/ 'material success/ 'social justice,' and 
'the service of humanity.' Tlie first three are found tlirougliout 
our Mstory; the last two have come to prominence within the 
past two or three generations, but were doubtless implied in the 
first three from the start. Democracy, in the sense of political 
democracy, or self-government, should be shown in the teaching of 
American Mstory to be one of the earliest ideals for which the col- 
onists and the fathers of our republic stood. In more recent times 
the effort has been to purify this democracy and make it practicable 
as a form of government in large and complex populations. To 
do this we have been gradually brought to realize the necessity of 
developing more complete democracy in our social relations and 
even in our industrial life. 

From the early days of our Revolutionary War, national unity 
has been one of the ' pattern ideas' which our nation has sought 
to realize. To realize this idea the Civil War was fought, but 
not until the Spanish War did the sense of national unity come to 
pervade and dominate the whole nation. But during the present 
war it has again become manifest that we have not realized this 
ideal in its full measure, and our efforts are now being directed to 
inculcate like-mindedness, harmony, and fraternity among all ele- 
ments of our population. 

As soon as national unity was realized, the conquest and de- 
velopment of the material resources of our continent began to ab- 
sorb the energies of the American people. At first, this energy was 
directed toward the settlement of the West and the opening up of 
agricultural and mineral sources of wealth. Later, mechanical in- 
vention was developed as a new method of harnessing natural 
forces and achieving material success. Still later, scientific and in- 
dustrial education came to be emphasized as the means of attain- 
ing the highest national efficiency in material and economic lines. 

This exploitation of the material and economic resources of the 
country was largely directed, at first, in an individualistic way, 
that is, to the end of ' private profit.' This led to the exploitation 
of class by class, and to social injustice. Hence arose the demand 
for social justice as between classes, which first manifested itself 
in our history in the consideration of the status of the negro slave. 



104 TEE SEVENTEENTH YEAEBOOK 

A great part of the political history of the nineteenth century cen- 
tered around the securing of social justice to the negro. Later, 
the securing of social justice to our working classes generally be- 
came, especially in the early years of the twentieth century, the 
dominant concern of our politics. This is perhaps still the chief 
note in our internal politics during the present war, and we now 
realize that social justice must extend even to the immigrant laborer 
among us. 

Throughout our history, perhaps, there has been more or less of 
the ideal of service to humanity in our struggle to secure liberty, 
justice and fraternity ; but this ideal became manifest only during 
the Spanish War, when altruistic motives led the majority of our 
people to favor intervention in Cuba. During the present World 
War the same ideal has led us finally to interfere in the struggle 
in Europe and to see that we cannot establish liberty, justice, and 
fraternity for ourselves unless we help to establish them also for 
all the nations of the world. 

This outline is not offered in anything more than a tentative 
way, and only to illustrate the spirit in which I would wish to 
have American history taught in our public schools. It should be 
taught, in other words, so as to inculcate the ideals of good citizen- 
ship and to give insight into the social and political problems with 
which our nation has grappled from the beginning and with which 
it is still grappling. Of course, errors and blunders in our history 
should not be overlooked, as the child may often learn the lessons 
of good citizenship from these more effectively than from our suc- 
cesses as a nation. Our history should teach humility as well as 
loyalty and devotion to national ideals ; it should be especially made 
to emphasize the necessity of greater intelligence and good will on 
the part of the citizen as he deals with the increasingly complex 
social, political, and economic problems of our national life. I 
should favor teaching history in general, therefore, from the 'prob- 
lem' point of view, and the more concrete and 'up-to-date' the 
problem can be made for the child, the better. I should certainly 
not favor teaching our history as a sequence merely of important 
dates and events. Concerning the pedagogical details necessary 
to the working out of a practical course in American history taught 
from the above point of view, I do not feel competent to offer an 
opinion. 
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in 

E. B. G-BEENE 
Professor of History, University of Illinois 



In any discussion of Mstory in tlie general scheme of public 
education, we must face squarely an important difference in point 
of view between tlie Mstorian as man of science and tlie educational 
administrator or public school teacher who is responsible for the 
training of young people for citizenship. The former is primarily 
concerned with the ascertaining and disseminating of accurate 
knowledge with regard to the subject matter of Ms science; the lat- 
ter thinks first of the effect of this body of teaching upon the intel- 
lectual habits and outlook' of the pupil. Does this difference of aim 
imply a difference of attitude so serious as to prevent cooperation 
between the two groups of workers? Has the scientific Mstorian 
anytMng to offer to the man who is primarily concerned with the 
formation of a rational type of patriotism? 

Most Mstorical scholars have had misgivings about the associ- 
ation of Mstory with patriotism. The so-called e patriotic ' teach- 
ing of Mstory has too often nourished Chauvinism and developed 
the most extreme forms of national self-conceit. The possibilities 
for evil of tMs method have found in Prussian schools an absckrecJc- 
endes Beispiel wMch is not likely soon to be forgotten. Against 
tMs sort of ' patriotic 7 Mstory, the scientific Mstorian has protested 
and must continue to protest with all Ms might the more so be- 
cause the ostrich habit of refusing to look the facts squarely in the 
face is scarcely less futile for the patriot than for the scholar. 
Some distortion or coloring of our vision by emotional factors of 
one Mnd or another can hardly be avoided, but let us get as near 
as we humanly can to seeing things as they really are and have 
been. 

Undoubtedly, then, the association of patriotism with science 
in the teaching of Mstory is beset with difficulties that are real and 
serious so serious that many scholars take refuge in a Mnd of 
monastic detachment from the 'dust and heat' of contemporary 
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problems. Not all students of Mstory, however, are satisfied with 
this " fugitive and cloistered virtue." For some of them at least, 
the perversion of historical material by misguided patriots is a dan- 
ger to be guarded against, but not a sufficient reason for abandoning 
the field. They are not disposed to find in history hard and fast 
maxims applicable to all times and places; they realize the extreme 
complexity of any great historical event or movement and the fu- 
tility of many analogies which seem plausible enough on the sur- 
face. But when all is said and done, they are ready to do what 
they can to make the facts of history, scientifically ascertained and 
sincerely interpreted, serve the uses of an intelligent patriotism. 
How this may be done is a problem requiring for its adequate dis- 
cussion much more space than is here available, but a few sug- 
gestions are offered with some reference to the particular crisis 
through which we are passing. 

It seems safe to say, first, that 'Mstorical-mindedness' is in it- 
self a valuable asset for the citizen and for the nation. "We may 
define that attitude in various ways, but perhaps its most important 
element is the consciousness in the individual of Ms membership in 
a continuing community. The historically-minded person, young 
or old, is the one who feels his comradeship, not only with those who 
share with him the community life of the present, but scarcely less 
with those who in the past have built up the social fabric of which 
he is a part, and with those others, yet unborn, whose life must de- 
pend in some measure on what he and others like Mm are do- 
ing today. Something of that historical vision there must be in 
every citizen who, with a reasoned patriotism, deliberately gives 
up Ms individual life in defence of Ms country, and its ideals. 
Indeed, the strength of any nation must depend in large 
measure upon the proportion of its citizens who realize this 
essentially Mstorical conception of their part in a continuing 
community as something more important than their individual for- 
tunes. Here, surely, is common ground where Mstory and patri- 
otism may meet without disloyalty to the ideals of either. 

In all this there is no question of twisting facts to bring out 
the virtues of a reigning dynasty, or a dominant party, or even of 
one's own country. Indeed, the rationally patriotic teacher of 
American history should be more concerned than any other to read 
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the record straight to find in its failures and blunders, no less 
than in its successes and achievements, an infinite variety of sugges* 
tions for the problems of contemporary life. It happens, for in- 
stance, that we are now involved in war, a war radically different 
in many respects front any in which we have ever before been en- 
gaged; and yet it has already brought to the front certain funda- 
mental issues which have been illustrated in our previous experi- 
ence. "We find ourselves almost irresistibly recurring to the ex- 
periences of Washington in the Revolution and of Lincoln in the 
Civil War for precedents to be followed or mistakes to be avoided. 
What has our experience shown as to efficient and inefficient ways 
of raising soldiers, as to sound and unsound methods of financing 
war, as to the variety of ways in which civilians, young and old, may 
help or hinder the national cause? It is not necessarily true that 
methods which proved mistaken in the past may not succeed under 
new conditions in the future ; but experience is at least suggestive, 
as in the case of Washington's trials with the militia, or of paper 
money experiments in the Eevolution and the Civil War, and may 
at least save us from a thoughtless stumbling into obvious pitfalls. 
American biography should be dealt with in a similar spirit. 
The one-sided idealization of our historic leaders has often provoked 
modern writers to extreme reactions in the opposite direction. 
Even with young pupils it ought to be possible to show that great 
personalities like Franklin and Jefferson and Hamilton, are not 
to be explained by the simple formula of hero-worship, at the one 
extreme, or the scarcely less over-simple formula of economic de- 
terminism, at the other. The proper teaching of American history 
in the schools ought to help the young citizen to see that a really 
great leader may make unlucky mistakes, as Abraham Lincoln did 
when he appointed his first Secretary of War, or when he commis- 
sioned certain "political brigadiers ; 3> that the hasty judgments 
of contemporaries may prove to be mistaken, as when in 1864 a 
large proportion of Lincoln's own political associates were con- 
vinced that his administration had been a failure. If teachers can 
set people to thinking along these lines, it will help to make them 
fairer, more discriminating critics of the men for whom they will 
have to vote. 
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One last suggestion is offered, with, full appreciation of the 
difficulty of carrying it into effect. The events of the past few 
months are gradually convincing the American people that even 
our great Republic of the West is vitally concerned in the move- 
ments of the old world. As a matter of fact, our connection with 
Europe the European element in .American history has always 
been much more important than the textbooks would lead us to sup- 
pose. The predominance of English speaking people in America 
was the result of a great conflict in which the genius of William 
Pitt and the armies of Frederick the Great were important factors. 
We owed our success in the struggle for independence in large 
part to the desire of France and Spain to restore what seemed to 
them a better political equilibrium in Europe, and more particu- 
larly, we owed it to our alliance with France. Our Declaration of 
Independence and our State constitutions with their insistence on 
government by "the consent of the governed" gave new courage 
to the radical thinkers of Europe and were among the many influ- 
ences which inspired the great revolution in France. The Louisi- 
ana purchase and the Monroe doctrine, the declaration that Amer- 
ica at least must be "made safe for democracy," can not be under- 
stood without some notion, of European history. The same is true 
of the great movements of immigration which have changed so rad- 
ically the character of our population. It is equally true that the 
historic ideals of America cannot be fully appreciated without com- 
paring them with those of a liberal parliamentary government like 
that of Great Britain or an intensely monarchical and aristocratic 
system like that of Prussia. In the face of our new international 
problems, the restricted outlook of our older teaching has become 
not only undesirable but dangerous. 
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ALBERT BUSHNBLL HABT 
Professor of Government, Harvard University 

How did American history come to be almost a universal study 
in the schools of the United States ? It was the American Bevolu- 
tion which fired the imagination of the people and led to the writ- 
ing of the earliest textbooks. They were based chiefly on the story 
of the colonial settlements, the virtue and prowess of the men of 
the Kevolution, and the story of the American Indian. Later the 
"War of 1812 and the Mexican War were added to the course of mil- 
itary glory and invariable victory, and then some of the political 
history became attached to this mainly military view of the things 
significant in the United States. The Civil War emphasized for 
the next generation the military side of our history. Not till about 
1890 did school textbooks strive to awaken a major interest in the 
arts and events of peace. 

Textbooks prepared upon such a basis no longer answer for 
the needs of the schools. Even in the midst of war the attention 
of the nation is directed to the resources, transportation, manu- 
factures, finance, industries, and agriculture of the country,* and 
to the problem of drawing out the man-power, woman-power and 
child-power of the nation. Problems of immigration, citizenship, 
labor, and social organization press upon every thinking mind. If 
the schools are to perform the task for which they are created, that 
of helping to put into children's minds a sense of the vital forces 
of the republic, and of how the people have worked out a society 
and government which, make national existence possible, textbooks 
of history must deal with the things that have made the nation 
what it is. 

To this end a history that is principally a reading book does 
not contribute the requisite structure: every school book ought to 
be as readable as the nature of the case allows, but anyone who has 
ever gone through such delightfully easy and readable books as 
Green's English People and Fiske's Discovery of America realizes 
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that a history may be fatally fluent when used by young people. 
A textbook of American history is for many children their only 
contact with the story of their own country, and the make-up must 
be such as to fix the attention. Devices of print, numbered sec- 
tions, and indicated sub-divisions of sections, are a help to the 
learner and an aid to the teacher in the highly important task of 
ascertaining whether the child's mind has really appropriated the 
sense of the book. 

The modem textbook ought to have a good outfit of pictures 
and maps. This is a picture age. Monthly, weekly, and daily pa- 
pers overflow with pictures. A good part of popular education is 
absorbed from the 'movies;' but textbook illustrations ought to be 
largely of real things, which add clearness and life to the text. 
Maps are pedagogically still more important, for they are graphic 
means of telling important things in a parallel language. 
The proper use of accurate, well-distributed, and appropriate maps 
makes a clear addition to the text, and helps to build up in the 
child's mind a sort of skeleton map which will be serviceable 
throughout life. 

The good textbook should recognize the fact that some schools 
have, and will use, additional historical material, and should there- 
fore contain serviceable chapter bibliographies, condensed and care- 
fully selected. Lists of topics or questions are a reasonable con- 
cession to the busy teacher who finds them an aid in class work. 
In fact every convenience that the textbook writer can introduce 
within the limits of his book goes toward augmenting the teaching 
power of the teacher. 

The most serious question in textbooks of American history 
is their content: and every writer of such books discovers that he 
must leave out a great number of things which are interesting in 
themselves and helpful for an understanding of the progress of 
American history. In this process of rigorous and often painful 
selection, the writer ought to keep in his mind the following guid- 
ing ideas. 

(1) The personal element must not be left out at any stage. 
Men like Franklin, Washington, Lincoln, Cleveland, are gifts to 
mankind; important not only for what they have said and done, 
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but also because they represent the highest reacli and aim of their 
time. 

(2) Military events and movements should be decreased to 
small compass. The really important thing in all wars is not the 
battles but the effort of the nation to rise to the crisis, to go through 
such tremendous experiences as are now upon the people of the 
United States. 

(3) Politics and parties can be strung on a chronological 
wire, of which the supporting posts are the presidents and other 
recognized leaders ; but party struggles, except so far as connected 
with questions which are still vital, are far less significant than 
other elements in the nation's history. 

(4) The social life of America at various epochs is interesting 
in itself and serves to keep in mind the essential idea that American 
history in past times has been carried on by much the same kind 
of people as today. 

(5) The history of the separate states is good each for its 
own community; but all school children should realize that the 
Union has been made up of geographic sections: New England, 
the Middle Colonies and States, the South, the West and the Far 
West. True history must keep account of the relations and the 
rivalries of these sections. 

(6) The actual United States is not a region, but a group 
of a hundred million people. No history does its duty that does 
not bring out the race elements, the social organizations, the dis- 
tribution of population, and especially the immigrants and re-emi- 
grants. 

(7) The economic life of the people is made up of the extrac- 
tion of the fruits and the mineral bounties of the earth, and their 
combination into things useful for mankind ; hence a school history 
must contain an account of the growth of knowledge and of pro- 
cesses, of new industries, of methods of transportation, of conser- 
vation of the gifts of nature. 

(8) In the present world of enormous combinations of busi- 
ness and labor, it is imperative that even children should under- 
stand something of the increase of ^capital, the great aggregations of 
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wealth, and tlie means of keeping a balance between the interests 
of capital and labor. 

To interweave these descriptive matters with the thread of con- 
secutive history and the succession of events is a hard task ; but he 
who cannot fit them together into some kind of unity, into a book 
which can be read with some pleasure and some advantage, and 
which will serve as the basis for classroom work, may as well aban- 
don Ms pen, for that is what America is doing, and a knowledge of 
it is what the schools must have. 
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W. H. MACE 
Professor of History, Syracuse University 

The content of history for these grades should deal with great 
historical characters and with historical events. Emphasis should 
be distributed as follows: upon great characters for Grades IV and 
V, upon events for Grades VII and VIII, and about evenly divided 
for Grade VL 

The thing that most profoundly stimulates interest and char- 
acter is the moral content of the individual's action. This moral 
or ethical side appears in the hero's struggle against obstacles and 
his victory over them, whether the difficulty be political, social, or 
economical. The story, whether oral or written, must set out these 
conflicts in a clear and sticking way. The son of the well-to-do will 
admire Lincoln's conflict with ignorance and poverty and his vic- 
tory^ over them, while the son of the poor will catch hope from the 
results of this struggle. His battle with Douglas was almost en- 
tirely a political one, but the moral contrast displayed by the two 
men has great lessons. The struggle of Thomas Edison to achieve 
distinction is a fine illustration in the industrial field. His strug- 
gle against poverty when a newsboy and a wandering telegraph op- 
erator will stir sympathy, and his great achievements will stimulate 
endeavor. 

These illustrations are given to show that present-day study of 
history is not all of war and politics. And while the number of 
stories dealing with purely economical characters should be in- 
creased, the danger is of plunging into a field which bears the title 
of popular clamor, but which falls far short of giving a great moral 
uplift to the pupil. Perhaps the result would not be so disastrous 
in the new field if our teachers were more thoroughly trained to do 
their work. This work may be worse than failure. If it is dry and 
uninspiring, it may result in creating a dislike for the subject. 

The purpose of the fifth year is to give some notion of European 
history with particular emphasis on the beginnings of American 



SEVENTEENTH YEARBOOK 

Mstory. The pupil is now ten years old; for tMs reason and for 
the fact that he has given two years to the story of men and women 
who have done great things, he is able to take history in a more 
complex form. In this new phase he is able to look at history in 
which the great man is beginning to disappear; in which he is still 
a leader but only a leader. As he approaches the end of the fifth 
year, the leader merges himself into the action which we call an 
event. 

In Grades VII and VIII the emphasis is upon the event an 
action in which our leader may be one of many. The effort is to 
make the pupil see the action of people. If the teacher is skilled 
in her work, the pupil will be able to look upon the leading events 
of these two years as if he had been a part of them as if he had 
participated in them. 

This vividness may extend to industrial and economic as well 
as to political history. Here in these last years of the grammar 
school we have a wider range of events from which we can select. 
And there is no particular reason why they should not be chosen 
from industrial history so as to even up our once somewhat one- 
sided course. 

The economic history is more abstract especially in its finan- 
cial aspects than other historical facts. In order that the history 
may live and attract it should be concrete from start to finish. 
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VI 



DAVID SNEDDEF 
Professor of Education, Teachers College, Columbia University 



1. The important and practicable specific aims of pnblic school 
education for boys and girls from ten to fifteen years of age include, 
along with others relating to physical well-being, cultural develop- 
ment and moral training, several aims which have primarily in view 
good citizenship, in a somewhat restricted and therefore workable 
sense of that term. But at present very little of the direct instruc- 
tion and training given to pupils of the ages indicated demonstrably 
functions as education for citizenship. We can readily assume that 
thd discipline of the school, the personalities of teachers and prin- 
cipal, and the varied self -initiated group-activities of the pupils 
themselves, all contribute indirectly, or thru their educative by- 
products, to good citizenship. But only by vigorous use of the im- 
agination can we assume that geography, grammar, literature, arith- 
metic, manual training, music, and the other school subjects as they 
are now taught, make appreciable contributions to the qualities 
(specific habits and habitual attitudes, appreciations, varieties of 
insight and understanding, ideals, active motives) that we should 
easily identify as characteristic of 'good citizenship.' 

It has been commonly taken for granted that some 'knowledge' 
of American history is essential to good citizenship ; and, as a re- 
sult, American history, as a { subject of study' for children from 10 
to 15 years of age, has attained a large place in elementary school 
currieulums. The 'content' of the subject, as commonly taught, 
is quite accurately exhibited in the textbooks generally used. This 
content, for Grades four to six, is usually made up of easy narrative, 
story materials, and biographies. For Grades seven and eight it 
consists of very condensed statements of detailed fact and generali- 
zation, presented in rigid chronological order, and with substantially 
no cross reference to contemporary conditions and problems. 

2. It is submitted that any serious attempt to evaluate the 
results of the teaching of this American history by all but a bare 
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fraction of teachers (one in a thousand having native genius suffi- 
cient to reorganize the subject in process of teaching it) will result 
in the conviction that such teaching has no substantial functional 
value for the rank and file of pupils (exception must again be made 
for the rare genius) in laying foundations of good citizenship as 
these may be expressed in terms of habit, appreciation, under- 
standing, ideal, or motive. This failure may be ascribed to many 
causes: To emphasis on political and military history sufficient 
to exclude those topics and considerations which are of most con- 
cern to the average citizen; to multiplication of highly digested 
statements of data and conclusions, irrespective of their interest 
or pertinency ; and to inclusion and elaboration of topics with no 
reference to their bearing on civic problems of the present or future. 
But most of all must it be ascribed to the probable impossibility, 
under any circumstances, of using the materials of history, when 
organized on the bases approved by the historian, as useful means 
of civic education. History, for the purposes of the historian (and 
perhaps also the purposes of the student pursuing it from cultural 
motives) must be organized largely on a chronological basis; the 
inclusion of topics and emphasis thereon must be determined largely 
by their significance to thei societies of the past times in which the 
events occurred; and the 'unity' of the subject (as alleged, but of 
course hardly ever realized in textbooks) must be preserved. 

But the "problems' of the citizen are of today or tomorrow; 
and when in the case of any problem, historical perspective is essen- 
tial to its understanding, the importance of the strand of history, 
rapidly tapering to a point in the past, which is required for the 
purposes of such perspective usually bears no relation to its impor- 
tance in historians' history. For example, the struggle of the French 
and the English for possession of large portions of North America 
necessarily looms large to the historian ; but rarely, and then only 
incidentally, does it affect understanding of contemporary problems 
of citizenship. Conversely, problems of transportation of commod- 
ities, which in a hundred ways confront and baffle all good citizens 
today, havej practically no history that is illuminating and sugges- 
tive back of 1840. Examples could be multiplied. 

3. As a basis for discussion, the thesis is here submitted that 
American history, as commonly organized, should be employed in 
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the civic education of youths 10 to 15 years of age, primarily as 
reference material only. It should not be studied that is analyzed 
intensively, interpreted, and memorized except in just sufficient 
measure to make the use of its materials for reference purposes easy 
and effective. Probably the equivalent of twenty hours study in 
each grade from the fourth to eighth would be sufficient for these 
purposes. 

The time and energy now given to the study of history should 
hereafter be devoted to a study of those topics which obviously have 
contemporary and future significance for citizenship, and, where it 
is evident that the events and ideas of the past can, for the learners 
under consideration, contribute to understanding of these problems 
and to the formation of ideals, the historical materials should be 
made accessible and, to the extent necessary, studied. In the ease 
of almost any topic meeting the conditions here suggested, it will be 
evident, of course, that only certain aspects or elements can profit- 
ably be studied by pupils of stated degrees of development. For 
example, the immigration, education, and assimilation of non- 
English-speaMng foreigners to this country embraces many prob- 
lems of the) utmost significance to all citizens. Some of the phases 
of these problems can readily be grasped by pupils of ten years of 
age whose parents were themselves immigrants or who have been 
closely associated with immigrants. Other phases of these prob- 
lems, including much of the interesting history of immigration in 
the 17th, 18th, and 19th centuries (and also of Flemish migrators 
into England, of barbarian into the Roman empire, and even of 
earlier legendary migrations) can well be apprehended by pupils 
of the seventh and eighth grades. 

The perennially strained relations of labor and capital, the 
'cleaning up ? of cities, the further development of agriculture, the 
stabilizing of our public fiscal affairs, the occupation and develop- 
ment of public lands, mines, and water-power opportunities, the 
improvement of transportation, the development of right interna- 
tional relationships, the further evolution of suffrage and right 
methods of voting, the regulation of business in vice-producing com- 
modities like alcoholic beverages all these and a hundred other 
similar topics in their non-partisan aspects are certainly no more 
difficult than the topics which pupils are forced to study as Amer- 
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lean Mstory and certainly many times more profitable as prepara- 
tion for intelligent citizenship. 

Some, devoid of sense of humor or of the sweet wisdom of prac- 
tical experience, will still murmur "But how can youths under- 
stand these questions if they do not know Mstory ?" Would these 
critics insist that before youth can partly appreciate and partly 
understand the "flower in the crannied wall" it must first under- 
stand "what God and man is!" 
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WE 

(By a Contributor Who Wished to Have His Name Withheld) 



I am impressed with, the fact tliat altogether too mneli attention 
is paid to the separate Mistorical development of a separate country, 
and too little attention paid to the events which, at the same time, 
transpired in others, which have had a determining 1 influence on the 
one country whose history is being studied. In my experience in 
active life, I have found a few men particularly well equipped 
intellectually who had been given, in school, a picture of what had 
occurred at a given periodj in all European countries, for instance. 
They knew how to place prominent persons and facts in their rela- 
tion to one another, had a clear impression of what influences had 
been active in countries adjoining each other, and knew thereby the 
essential features of history much better than others who had been 
taught by the usual method. I must confess that I have met few 
who had had the benefit of what seemed to me the preferable 
method, but the impression made on my -mind must have been so 
much the more emphatic ; it has clung to me for years. 

I think too, that} while nationalistic teaching of history is to a 
certain degree necessary and desirable, children should be taught 
that above all consideration for one's own country, there is the obli- 
gation to direct public policy and acts according to "a decent re- 
spect to the opinions of mankind/' and that this consideration 
should supersede all self-interest, under all circumstances. It 
should, in my opinion, be pointed out as the theory which permits 
full and free action of separate political units, without requiring 
"internationalism" as a safety valve. 
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SUMMARY 
W. 0. BAGLEY 

From these discussions it seems safe to infer that the most sig- 
nificant weakness of history as now taught and studied in the ele- 
mentary school is the narrowness of its scope and content. Our sud- 
den transition from the position of a sequestered and perhaps some- 
what self-satisfied nation to a position that in many ways lays upon 
our people the responsibilities of a world-leadership indicates clearly 
the need of an understanding of our national development in the 
light of preceding and' parallel movements in Europe. 

At the same time, the contributors to this symposium are appar- 
ently in agreement that elementary history has still an important 
function to discharge in the development of a true patriotism. JBut 
the qualifying adjective is important. The care with which they 
have formulated the conception of patriotism testifies to their belief 
that the older conceptions need some measure of reconstruction. 
Certainly that kind of patriotism that can be nourished only on 
deliberate misstatements and misinterpretations of historical facts 
is not the kind that a great democracy can afford to cultivate. 

Especially important in this connection is the wholly admirable 
suggestion that the teaching of national history should develop not 
only a national consciousness, but also a national conscience a col- 
lective sensitiveness to dishonor in international relationships com- 
parable in every essential way with the sensitiveness to dishonor in 
personal relationships which constitutes the backbone of individual 
morality. It is the lack of this national 'conscience 5 in our present 
enemy that disgusts and repels us when we contemplate his atroc- 
ities, and one of the first points of agreement in the coming federa- 
tion of nations might well be an insistence that every nation through 
the instruction in history offered in its lower schools should take 
steps to develop this collective conscience. As some of these writers 
clearly point out, this is not an impossible function for the teaching 
and study of history to fulfill. 

Closely related to this, and particularly important in a democ- 
racy, is the suggestion that history, if taught aright, can make the 
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future citizen a "fairer and more discriminating critic of the men 
for whom he will vote." Indeed, when we think of the responsi- 
bilities that the American people must assume in the new world 
order, it is hard to overestimate the fundamental importance of this 
aim in the teaching of history. A democracy must have its leaders, 
but the very essence of democracy lies in the fact that this leader- 
ship must be constantly subject to evaluation by all of the people. 
Certainly no school subject is so well adapted as is history to de- 
velop upon a broad scale this discriminating- attitude of mind 
through which alone the perils of cheap politics and demagoguery 
may be avoided. 

It is apparent, too, that there is need for a broader aim for his- 
torical instruction than is indicated by the older implications of the 
formula, "Training for citizenship." The citizen is more than a 
voter, as practically all of our writers insist. There is need for an 
understanding and appreciation, not only of our political develop- 
ment, but also of our industrial and economic development, and 
there are present problems and clearly predictable future problems 
in the solution of which the perspectives and backgrounds which 
historical study alone can furnish may be and should be determining 
factors. While the conviction of one of the writers that the study 
of history in the elementary school may best be comprised in a 
series of references suggested by the study of present and future 
problems represents an extreme position, there can be no contro- 
versy over the importance of making a much larger use of the 
'problem' than we do now, and of training even the elementary pu- 
pil to search for causes and to view present problems in the light of 
their genesis. This, we take it, is the essence of that "historical- 
mindedness" which is listed as one of the desirable outcomes of 
historical study. 

Every discussion of aims and values in the teaching of history 
reveals a serious handicap under which the teacher of this subject 
must do his work. "We refer to the difficulty of formulating the 
outcomes of teaching in a way that clearly suggests both a method 
of procedure that will insure these outcomes and a reliable test of 
the efficiency of the teaching. The teacher of elementary arithme- 
tic, by way of contrast, can define the desired outcomes of his sub- 
ject in terms very largely of skill, and likewise the teachers of writ- 
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ing ? spelling, oral and written composition, and the beginners 7 
courses in foreign languages. But skill in this narrower sense is 
certainly not what the teacher of Mstory is seeking to develop. It 
wiH he noted that our contributors nse two groups of words in de- 
fining their aims. One group includes such terms as loyalty, patri- 
otism, good citizensMpj unity, brotherhood, justice, fairness, and 
the like. The other group comprises such words as habitual atti- 
tudes, interests, appreciations, insight, understanding, Mstorieal- 
mindedness, pattern-ideas, motives, and ideals. The words of the 
first group represent complex sociological virtues which are usually 
considered objectively. The words of the second group refer to 
things psychological, subjective, to mental states or processes. It 
is clear/ that the more remote objectives in the study of elementary 
Mstory must be formulated in terms of the former group ; but what 
the teacher must do is to insure the immediate, subjective outcomes 
which in right combination will spell those more complex, sociolog- 
ical virtues. 

The continual recurrence of the terms "ideals," " apprecia- 
tions," and "attitudes," and especially the care with which one of 
the writers has constructed a list of the specific ideals which should 
emanate from the study of elementary Mstory and the urgency with 
wMch another protests against traditional methods of instruction 
as utterly inadequate to engender these outcomes, suggests the im- 
portance of a dearer understanding of what these apparently im- 
portant things really are and how the processes of education may be 
turned toward their development. Concerning the objectives of 
historical teaching there seems to be little disagreement; upon the 
materials, too, there is substantial harmony; but between the ob- 
jectives and the materials there is a veriable terra incognita. 



123 



MEMBERS 

HONOEAET MEMBEBS 

Dewey, John, Columbia University, New York City. 

DeGarmo, Charles, Coeoanut Grove, Fia. 

Hanus, Paul H., Harvard University, Cambridge, Mass. 

ACTIVE MEMBERS 

Allen, Piske, State Normal School, Charleston, HI. 

Allison, Samuel B., Dist. Supt. in charge of Special Schools, Board of Educa- 
tion, Chicago, HI. 

Andrew, William, 288 Essex St. T. M. G. A. BIdg., Salem, Mass. 
Axbaugh, W. B., Ypsilanti, Mich. 
Atwater, Jane S., 6938 B. End Avenue, Chicago, HI 
Ajdine, Howard E., Head of Eng. Department, Cleveland, Ohio. 
Baehman, B. H., Tarboro, N. C. 

Bagley, William C., 576 Fifth Avenue, ISFew York City. 
Baker, Harry T., 6145 Ingleside Avenue, Chicago, HI. 
Ballou, Prank W., care of School Committee, Mason Street, Boston, Mass. 
Barnes, Harold, Girard College, Philadelphia, Pa. 
Barnes, Pereival S., 417 W. 121st St., New York City. 
Becker, Ernest J., Eastern H. S., Baltimore, Md. 
BeU, J. Carleton, Brooklyn Tr. School, Brooklyn, N. Y. 
Benedict, Ezra W., Prin. of H. S., Mt. Kiseo, Westehester COL, New York. 
Benson, C. E., State Normal School, Cape Girardeau, Mo. 
Benton, G-. W v 100 Washington Square, New York City. 
Beveridge, J. H., 508 City Hall, Omaha, Neb. 
Blaine, Mrs. Anita MeCormick, 101 E. Erie St., Chicago, HL 
Bland, W. P., Supt. of Schools, Globe, Arizona. 
Bolenius, Emma Miller, 46 S. Queen Street, Lancaster, Pa. 
Bolton, Frederick E., University of Washington, Seattle, Wash. 
Bonney, S. E., Shelbina, Mo. 

Boyer, Chas., Supt. of Schools, Atlantic City, N. J. 

Bradford, Mrs Mary D., Supervisor of Primary Education, Kenosha, Wis. 
Breckenridge, EHz., 962 Fourth Street, Louisville, Ky. 

Briggs, Thomas H., Teachers College, Columbia University, New York City. 
Brooks, Stratton D., University of Oklahoma, Norman, Okla. 
Brown, J. C., State Normal School, St. Cloud, Minn. 
Brown, John F., 780 Biverside Drive, New York City. 
Brown, J. Stanley, Supt. of Schools, Jo-liet, HL 
Brumbaugh, Martin G., Gov. of Pennsylvania, Harrisburg, Pa. 
Bryan, W. J. S., 6060 Berlin Avenue, St. Louis, Mo. 
Buehner, Edward F., Johns Hopkins, University, Baltimore, Md. 
Buckingham, B. B., Capitol Bldg., Madison, Wis. 
Buellesfield, Henry, 7237 Jackson Blvd., Forest Park, HI 
Burnham, Ernest, State Normal School, KaJamazoo 1 , Mich. 
Burruss, Julian A., State Normal and Ind. School for Women, Harrisonburg, Va.. 
Bush, I. B., Supt. of Schools, Erie, Pa. 

Butterworth, Julian E., University of Wyoming, Laramie, Wyoming. 
Cameron, E. H. Prof., Yale Station, New Haven Conn. 
Cammack, I. I., Supt. High School, Kansas City, Mo. 
Camp, Frederick S., 52 Hoyt Street, Stamford, Conn. 



TSE SETESTEEyTH YEAMBOOK 



Catighley, John, Asst Bir. of Education, Education Department, Wellington, 

New Zealand. . ,. , . 

Chadsev, Charles B., Supt. of Schools, Detroit, Michigan. 
Chadwiek, B. D., Morgan Park School, Dululh, Minn. 
Chandler, J. A. C. ? Supt. of Schools, Biehmond, Va. 
Charters* W. "W., University of Illinois, Urbana, III. 
Oulds, Hubert G., 520 W. 124th St., New Tort City. 
Clark W- A., 312 B- Jefferson St., Barksville, Mo. 
Clement, J. A., De PJLUW University, Greeacastle, Indiana. 
Coffman, Lotus D., University of Minnesota, Minneapolis, Minn. 
Colvin, S* S.. Brown University, Providence, R. I. 
Condon, Randall J., Supt of Schools, Cincinnati, Ohio. 
ConradL Edward, Ma. State College for Women, Tallahassee, Fla. 
Cook, Albert S., Co. Supt. of Schools, Towson, McL, Station A. 
Cooke, Flora S. Francis W. Parker School, 330 Webster Avenue, Chicago, HI. 
Cook, John W., Pres. Northern 111. State Normal School, DeKalb, HI. 
Courtis, &. A. f 32 Eliot Street, Detroit, Michigan. _ 
Cox Philip W. L., Principal Junior H. S., St. Lotus, Mo. 
Crow, Charles S. T 136 High Street, Morgantown, W. Va. , 

Oabherlcy, Ellwood P., Leland Stanford Jr. University, Stanford University, 

California. 

Cunningham, Besdon J., Bozeman, Montana. 

Davidson, Percy E., Leland Stanford Jr. University, Stanford University, Gal. 
Davis. B. M., Miami University, Oxford, Ohio. 

Davis, Solon P. ? Dist. Supt. Henry Barnard School, Hartford, Conn. 
Deahl Jasper 1ST.. University of West Virginia, Morgantown, W. Va. 
Dearmont, Washington, Pres, State Normal School, Cape Girardeau, Mo. 
Dick, George S., Pres. State Normal School, Kearney, Neb. 
Doelle, John A., Supt. of Schools, Houghton, Michigan. 
Doyle, Mary B., 1009 E. 60th Street, Chicago, HI. 
Dyke, Charles B., Supt. of Schools, Millburn, N. J. 
Earhart, Lida B., 419 W. 119th Street, New York City. 
Eby, Frederick, University of Texas, Austin, Texas. 
Eby, Harvey L., University of Wyoming, Laramie, Wyoming. 
Ehler, H. F., Kaenie High School, Baeine, Wisconsin. 
Elliott, Edward C., Chan. University of Montana, Helena, Mont. 
Ellis. A. Caswell, University of Texas, Austin, Texas. 
Elson, William H., 1768 E. 89th St., Cleveland, Ohio. 
Engleman, J. O. ? Public School Office, Deeatur, HI. 
Ernst, L. E., Cote Brilliante School, St. Louis, Mo. 
Faddis, Jennie Eebecea, Asst. Supt. Pub. Schs., St. Paul, Minn. 
Fanger, Landis, Homestead, Pa. 

Farrington, Frederic B., Bureau of Education, Washington, D. C. 
Feeney, T. L., Miami University, Oxford, Ohio. 
Felmley, David, Pres. Illinois State Normal University, Normal, HI. 
Fitzgerald, Florence, London, Ohio. 

Forbes, George M., Eochester University, Rochester, N. Y. 
Foster, F. M.~, Iowa City, Iowa. 
Foster, J. M., Dansville H. S., Dansville, N. Y. 
Foster, H. H., University of Arizona, Tucson, Arizona. 
Frederick, J. M. H. ; Cleveland, Ohio. 
Frost, J. M., Supt. of Schools, Lansing, Michigan. 
Gard, Willis L., Ohio University, Athens, Ohio. 
George, Libbie, Room 6, Lib. Arts Bldg., Iowa City, Iowa. 
Gosling, T. W., Lafayette Bloom Seh., Cincinnati, Ohio. 
Graff, E. N., 508 City Hall, Omaha, Nebraska, 



MEMBERS 125 

Greene, C. A., 406 X. Pa. Avenue, Webb City, Mo. 

Greeson, Wm. A., Supt. of Schools, Grand Bapids, Mich. 

Griffin, Margery M., 4045 McPherson, St. Louis, Mo. 

Gullette, Albert, Prin, Holmes School, Minneapolis, Minn. 

Gwinn, J. M., Supt. of Schools, New Orleans, La. 

Haggerfy, M.' E., University of Minnesota, Minneapolis, Minn. 

Hall, John W., University of Cincinnati, Cincinnati, OMo. 

Halleck, Reuben Post, Prin. Boys 1 H. S., Louisville, Ky. 

Hall-Quest, A. L. ? University of Cincinnati, Cincinnati, OMo. 

Hamilton, Cora M., State Normal School, ITacomb, ML 

Hanifan, L. J., State Supervisor Eural Seta., Charleston, W. Va. 

Harris, Ada V. Stone, 6216 Howe St. JE. E., Pittsburgh, Pa. 

Harris, J. P., Normal Tr. H. S., Henryetta, Oklahoma. 

Hatch, W. H., Supt. of Schools, Oak Park, 111. 

Heckert, J. W., Miami University, Oxford, OMo. 

Heffelfinger, John B., Arkansas City, Kansas. 

Henderson, Herman 0., State Normal Seh., Milwaukee, Wis. 

Herxon, Miss Helen, 1933 Elysian Pielda Avenue, New Orleans, La. 

Hill, David Spence, University of Illinois, Urbana, Illinois. 

Hill, Patty Smith, Teachers Col. Columbia University, New York City. 

Holley, Charles E., Bellevue, Nebraska. 

Hoke, Kremer J., JDuluth. Public Schools, Duiuth, Minn. 

Horn, Ernest, 934 Kirkwood Avenue, Iowa City, Iowa. 

Horn, Paul W. 5 Supt. of Schools, Houston, Texas. 

Hosie, J. P., CMeago Normal College, CMcago, Illinois. 

Howell, Harry, AsheviUe, N. C. 

HutcMson, L. G., BHssfield, Mieh. 

Jeffers, Pred A., Supt. of Schools, Painsdale, Mich. 

Jenks, Jeremiah W., New York University, Washington Square, New York City. 

Johnson, Willis E., Northern Normal and Ind. Seh., Aberdeen, S. Dakota. 

Jones, Arthur J., University of Pa., PMladelphia, Pa. 

Jones, Elmer E. ? 1115 Church St., Evanston, HI. 

Jones, Prancis P., Hinghwa, Pukien, China. 

Judd, Charles H., University of CMcago, CMeago, HI. 

Judd, Zebulon, Prof., Auburn, Alabama. 

KeUey, Eoy B., Supt. Solvay High School, Solvay, N. Y. 

Kelly, P. J. ? University of Kansas, Lawrence, Kansas. 

Kemp, W. W., University of California, Berkeley, California. 

Kent, Harry I/., Agricultural College, Manhattan, Kansas. 

Kimball, J. P., Supt. of Schools, Temple, Texas. 

Kirk, John E., Pres. State Normal School, Kirksville ,Mo. 

Kirk, W. H., Supt. of Schools, E. Cleveland, OMo. 

Koch, C. P., Dept. of Pub. Instruction, Harrisburg, Pa. 

Koontz, J. A., Livingston Hall, Columbia University, New York City. 

Koos, Leonard V., University of Washington, Seattle, WasMngton. 

Latham, B. H., Winston-Salem, N. C. 

Lawrence, Isabel, State Normal School, St. Cloud, Minn. 

Lawson, W. C., Supt. of Schools, Bryan, Texas. 

Layton, Dr. S. H., Supt. of Schools, Altoona, Pa. 

Lewis, Homer P., Supt. of Schools, Worcester, Mass. 

Livingston, Alfred, Montana St. Col. of Agriculture, Bozeman, Montana. 

Logan, Anna E., Asst. Supt. of Schools, Cincinnati, OMo. 

Lowry, Charles D., Dist. Supt. of Schools, 1*643 Kenilworfeh Avenue, CMcago, 

Illinois, 

Lord, L. C., State Normal School, Charleston, HI. 
Luekey, G-. W. A., University of Nebraska, Lincoln, Nebraska. 



126 THE SEVENTEENTH YEARBOOK 

Liikens Herman T., Francis Parker Seh. ? 330 Webster Avenue, CMeago, HL 

Lull, H. G., State Normal School, Emporia, Kansas. 

McCartney, Livingston, Snpt. of Schools, Haimibri Mo. 

MeFarlancL Geor^ A., Pres. State Formal School, Valley City, N. Dale. 

MeParlffi, Clara H., 4716 Kenwood Avenue, Chicago, HI. 

Maekey. E., Snpt. of Schools, Trenton, N. J. 

Maphis' Charles G., University of Virginia, University, Va. 

MEM, S. M. N., Snpt. of Schools Terrell, Texas. 

Marsh, J. P., Asst. State Snpt. of Sehs., Charleston, W. Va. 

Maxwell, William H., Supt. of Schools, New York City. 

McAllister, Cloyd N., Berea, Ky. . . 

McDonald, Bobert A. P., Bates College, Lewiston, Maine. 

MeKennv, Charles, Pres. State Normal School, Ypsilanti, Michigan. 

MeMnr^ Charles A., Geo, Peabody CoL for Teachers Na^viJl^ Tenn 

McMurray, Frank M., Teachers CoL Columbia University, New York City. 

MeNaught, Mrs Margaret S., 1022 G Street, Sacramento, California. 

Mead, Arthur B. Prof., Ohio Wesleyan University, Delaware, Ohio. 

Mead, Cyrus D., University of Cincinnati, Cincinnati, OMo. 

Meleher, George, Library Bldg., 9th and Locust Streets, Kansas City, Mo. 

Mellyn Mary C., care of School Com. Mason Street, Boston, Mass. 

Miller, Irving E., State Normal School, Beffingham, Wash. 

Milter. James C., Dept. of Education, Edmonton, Alberta, Canada. 

Mills, Harriette M., New York University, Wash. Square New York City. 

Minnieh, H. G., State Normal College, Oxford, Ohio. 

Mitchell, H. Edwin, State Normal School, Moorehead, Minn. 

Monroe, Edwin S., Supt. City Schools, Muskogee, Okla. 

Monroe, Walter S., Kansas State Normal SdL, Emporia, Kansas. 

Morrison, H. C., See j y,, State Board of Education, Middletown, Conn. 

Muerman, J. C., Bureau of Education, Washington, B. C. 

Munson, O. P., Bock Springs, Wyo. 

Newman, Hugo, 538 W. 15.0th St., New York City. 

Newton, George A., Trinity University, Waxahaehie, Texas. 

Nichols, C. A., Southwestern University, Georgetown, Texas. 

Nicholson, Anna M., 1461 Alice Street, Oakland, California. 

Oberholtzer, E. E., Supt. of Schools, Tulsa, Oklahoma. 

O'BonneU, Jas. A., 95 Boerum St., Brooklyn, N. Y. 

Olio, A. S., University of Kansas, Lawrence, Kansas. 

O'Shea, M. Y., University of Wisconsin, Madison, Wis. 

Pandya, T. B., Barker's Bungalow, Baroda, India. 

Parker, Samuel C., University of Chicago, Chicago, Illinois. 

Pearson, M. E., Library Building, Kansas City, Kansas. 

Perkins, F. David, Supt. of Schools, Harlan, Ky. 

Peterson, O. E. Supt. of Schools, Sycamore, 111. 

Phelan, W. W., 536 Chautauqua, Norman, Okla. 

Philhower, Charles A., Belvidere, N. J. 

Pittinger, B. F., Psychological Examiner, Base Hospital, Camp Lee, Va. 

Porter, David C., Bridgeton, N. J. 

Pryor, Hugh C., Prin. Training School, 9th St. and Portland Place, Boulder, 

Colorado. 

Purkhiser, Lillian A., Supt. of Schools, Butland, HI. 
Pusey, E. D., Supt. of Schools, Durham, N, C. 
Putnam, Helen C., Providence, B. I. 
Ball, E. E., Pres. North-Western, Col., Naperville, HI. 
Bapeer, Louis W., University of Porto Bico, San Juan, P. B. 
Beid, O. L., 8th and Chestnut Sts., Louisville, Ky. 
Beigart, J, P., 31 Euclid Avenue, Yonkers, N. Y. 



MEMBEES 127 

Erodes, B. 1ST., Snpt of Schools, Winnetka, HI. 

Biehardson, Ira, Maryville, Mo. 

Bobison, Milton P., College View, Neb. 

Boell, B. G., Box 2098, Globe, Arizona. 

Rosier, Joseph, Pres. Normal School, Fairmont, "W. Va. 

Boy, "Victor Leander, NateMtoselies, La. 

Buediger, W. C., George Washington University, Washington, D. C. 

Bugg, Harold O., 5813 Dorchester Ave., Chicago, HL 

Bussell, James B., Dean, Teachers Col., New York City. 

Bynearson, Edward, Fifth Avenue High School, Pittsburgh, Pa. 

Sachs, Julius, Columbia University, New York City. 

Sehweining, O. C., Snpt. of Schools, Douglas, Wyoming. 

Seott, Z. E., Asst. Com. of Education, State Honse, Trenton, N. J. 

Slauson, Herbert M., Supt. of Schools, A-rm Arbor, Michigan. 

Smiley, Wm. H., Snpt. of Schools, Denver, Colorado. 

Smith, Eugene R., Headmaster, The Park Sch., Baltimore, Md. 

Smith, H. I/., Dean, School of Education, Bloomington, Ind. 

Smith, Margaret M. Mrs., Prin. Emerson School, Denver, Colo. 

Smoot, Lucy J., 4011 Baltimore, Kansas City, Mo. 

Snedden, David, Teachers College, New York City. 

Spencer, W. B., State Normal School, Bowling Green, Ohio. 

Starch, Daniel, University of Wisconsin, Madison, Wis. 

Stark, William E., Supervising Prin. of Sen., Haekensaek, N. J. 

Stillwell, Wm. Earle, Headmaster, University Sch., Cincinnati, Ohio. 

Stoekard, L. V., State Dept. of Education, Austin, Texas. 

Stone, Cliff W., Iowa State Tea College, Cedar Falls, Iowa. 

Stoutmyer, J. Howard, 406 W. 26th St., Kearney, Neb. 

Stowe, A. Monroe, Toledo University, Toledo, Ohio. 

Strayer, George D., Teachers College, New York City. 

Strong, Edward K. Jr., George Peabody College for Teachers, Nashville, Tenn. 

Strong, B. Norman, Arsenal School, Hartford, Conn. 

Stuart, Josephine B., 87 Mill St., New Bedford, Mass. 

Sutton, W. S., University of Texas, Austin, Texas. 

Suzallo, Henry, University of Washington, Seattle, Washington. 

Swope, Blanche A., University of Pittsburgh, Pittsburgh, Pa. 

Taft, Leanora E., 413 Belmont Avenue, Springfield, Mass, 

Tall, Lida Lee, 827 Hamilton Terrace, Baltimore, Md. 

Taylor, Joseph S., Dist. Supt. of Schools, 2275 Loring Place, The Bronx, New 

York City. 

Thompson, Frank E., University of Colorado, Boulder, Colorado. 
Thorndike, Edward L., Teachers College, New York City. 
Thurber, Charles H., Ed. Ginn and Company, Boston, Mass. 
Trabue, M. B., Teachers College, Columbia University, New York City. 
Truesdell, Benj. W., 412 N. Emporia Avenue, Wichita, Kansas. 
Updegraff, Harlan, University of Pennsylvania, Philadelphia, Pa. 
Vandewalker, Nina C., State Normal School, Milwaukee, Wis. 
Van Sickle, James H., Supt. of Schools, Springfield, Mass. 
Verplanek, Fred A., S. Manchester, Conn. 

Vincent, H. D., Prin. Public Sch. No. 3, Cor. 5th Ave and Jay St., Troy, N. Y. 
Volker, Wm., Main, 2nd and 3rd Sts., Kansas City, Mo. 
Waldo, Dwight, B., W. State Normal School, Kalamazoo, Mich. 
Walker, Elmer W., Supt. State School for the Deaf, Delavan, Wis. 
Weber, A. W., Normal Training Sch., Cleveland, Ohio. 
Wteber, O. F., Supt. of Schools, Belleville, HI. 
Weber, S. E., Supt. of Schools, Seranton, Pa. 
Weglein, David E., Western H. S., Baltimore, Md. 



12B TSE SEVENTEENTH YEAEBOOK 

West. Henry S., State Normal School, Towson, Hd. 

Whipple, G. M., University of Illinois, Urfoana, Illinois. 

White, W. D., Clio, Michigan. 

Wiles. Ernest P., Frin. Junior and Senior H. S., Evansviile., Ind. 

Williams, Henry G., 136 B. Gay Street, Columbus, OMo. 

Wilson, G. M., Iowa State College, Ames, Iowa. 

Wilson, H. B., Supt. of Schools, Topeka, Kansas. 

Wilson, Mrs. I/. I/f W., Southern High School for Girls, Philadelphia, Pa. 

Wise, Clayton F. ? 9232 Adams Ave., N. E., Cleveland, Ohio. 

Witham. Ernest C., Soiithington, Conn. 

Witmer, John B., Snpt. Two. H. S., Maywood, DL 

Woodv. Clifford, University of Washington, Seattle, Wash. 

Wright, Kobert H., Pres. Teachers' Tr. Sen,, Greenville, 1ST. C. 

Zinninger^ George E., 61 Dewey Avenue, Youngstown, Ohio. 



CONSTITUTION 129 



CONSTITUTION OP THE NATIONAL SOCIETY POB THE STUDY OP 

EDUCATION 

ARTICLE I 

Name. The name of tMs Society shall be "National Society for the Study 
of Education. } 3 

ARTICLE H 

Object. Its purposes are to carry on the investigation and to promote the 
discussion of educational problems. 

ARTICLE HE 

Membership. SECTION 1. There shall be three classes of members 
active, associate, and honorary. 

^ ISEG. 2. Any person who is desirous of promoting the purposes of this 
Society is eligible to active membership and shall become a member on approval 
of the Executive Committee. 

SEC. 3. Active members shall be entitled to hold office, to vote, and to 
participate in discussion, 

SEC. 4. Associate members shall receive the publications of the Society, 
and may attend its meetings, but shall not be entitled to hold office, or to 
vote, or to take part in the discussion. 

SEC. 5. Honorary members shall be entitled to all the privileges of active 
members, with the exception of voting and holding office, and shall be exempt 
from the payment of dues. 

A person may be elected to honorary membership by vote of the Society 
on nomination by the Executive Committee. 

SEC. 6. The names of the active and honorary members shall be printed 
in the Yeatrboofc. 

SEC. 7. The annual dues for active members shall be $2.00 and for 
associate members $1.00. 

ARTICLE IV 

Officers and Committees. SECTION 1. The officers of this Society shall 
be a president, a vice-president, a secretary-treasurer, an executive committee, 
and a board of trustees. 

SEC. 2. The Executive Committee shall consist of the president and four 
other members of the Society. 

SEC. 3. The president and vice-president shall serve for a term of one 
year, the secretary-treasurer for a term of three years. The other members of 
the Executive Committee shall serve for four years, one to be elected by the 
Society each year. 

SEC. 4. The Executive Committee shall have general charge of the work 
of the! Society, shall appoint the secretary-treasurer, and may, at its discretion, 
appoint an editor of the Yearbook. 
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SEC. 5. A "board of trustees consisting of three members snail be elected 
"by the Society for a term of three years, one to be elected each, year. 

The Board of Trustees shall be the custodian of the property of the So- 
ciety, shall have power to make contracts, and shall audit all accounts of the 

Society, and male an annual financial report. 

SEC. 6. The method of electing officers shall be determined by the Society. 

ABTICLE V 

Publications. The Society shall publish The Yearbook of the National 
for the Study of Education and such, supplements as the Executive 

Committee may provide for, 

ARTICLE VI 

Meetings. The Society shall hold its annual meetings at the time and 
place of the Department of Superintendence of the National Education Asso- 
ciation. Other meetings may be held when authorized by tlie Society or by 

the Executive Committee. 

ARTICIiE VH 

Amendments. This constitution may be amended at any annual meeting 
by a vote of two-thirds of voting members present. 
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MINUTES OF THE MEETING 
of the 

NATIONAL SOCIETY FOE THE STUDY OF EDUCATION 
AT KANSAS CITY, MISSOURI 

MONDAY EVENING, FEBRUARY 26, 1917 

More tlian a thousand persons assembled in the Grand Avenue 
Temple to hear the discussion of the Sixteenth Yearbook of the 
Society. President Chadsey called the meeting to order and pre- 
sided during the following program of addresses : 

Progress in fhe Study of Economy of Time. 

H. B. WILSON, Superintendent of Schools, Topeka, Kansas. 

Some Contributions to School Practice T~hat We May Expect From 
Time Economy. 
B. GL JONES, Superintendent of Schools, Bockford, HL 

A Critical Estimate of the Methods Employed in Determining Min- 
imal Essentials. 

L. D. OOITMAN, Dean College of Education, University of Minnesota, 
Minneapolis, IVO'Din. 

Economy and Efficiency in Science* Teaching. 

O. W. CALDWELL, University of Chicago, Chicago, HI. 

Use of the Syllabus as a Supervisory Instrument to Promote Effect- 
ive Training. 
E. HORN", University of Iowa, Iowa City, Iowa. 

Minimal Essentials in the Training of Teachers. 

W. C. B AGLET, Director School of Education, University of Illinois, 
Urbana, HI. 

After some discussion a brief business meeting of the Society 
was held. 

On recommendation of the Executive Committee and Board 
of Trustees, it was voted that the first sentence of Article IV, Sec- 
tion 3, of the Constitution be amended to read as follows: "The 
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president and vice-president shall serve for a term of one year, 
the secretary-treasurer for a term of three years." 

It was voted to endorse the following- resolution of the Execu- 
tive Committee: * 4 The National Society for the Study of Educa- 
tion will welcome the opportunity to enjoy the "benefits of affili- 
ation with the American Association for the Advancement of Sci- 
ence provided this privilege can he extended to all persons who 
are members of the Society during the year 1917." The Executive 
Committee reported that it was considering the feasibility of ar- 
ranging a joint program with Section L of the American Associ- 
ation in 1918. 

The President announced that the Executive Committee had 
reappointed GL M. Whipple as Secretary-Treasurer of the Society 
for a term of three years. The report of nominations presented by 
the Executive Committee and Board of Trustees was heard and 
the persons cited were elected, as follows : 

For President 

LOTUS B. COFFMAJST 

Dean, College of Education, University of Minnesota 

For Vice-President 

J. A. C. CHANDLER 

Superintendent of Schools, Biehmond, Virginia 

For Trustee (to serve three years) 

GEORGE MELCHER 
Director Bureau of Research and Efficiency, Kansas City, Missouri 

For Member of Executive Committee (to serve four years) 

ERNEST HORN 
Associate Professor of Education, University of Iowa 

CHARLES E. CHADSEY, President GTJY M. WHIPPUS, Secretary 



FINANCIAL ESPO&T 133 



FINANCIAL EEPORT OF THE SECRETARY-TREASURER OF THE 

NATIONAL SOCIETY FOR THE STUDY OF EDUCATION 

JAXUABY 1, 1917 TO DECEMBER 31, 1917, INCLUSIVE 

RECEIPTS IX)E 1917 

Balance on hand December 31, 1916 $2320.13 

From sale of Yearbooks by the University of Chicago Press, 
and the Public School Publishing Company: 

June to December, 1916 $ 610.86 

January to June, 1917 1242.62 $1853.48 

Interest on savings bank account : 

To January 1, 1917 $ 28.62 

To July 1, 1917 18.11 $ 46.73 

Dues from 882 members (current and delinquent) $1109.25 

Total income for the year $3009.46 

Total receipts, including initial balance $5329.59 

EXPENBITUEES FOR 1917 

Publishing and distributing Yearbooks: 

Printing 1200 15th Yearbook, Pt. Ill ("Junior High 

School 3 ') $ 361.96 

Printing 1300 additional 15th Yearbook, Pt. Ill 63.96 

Paper, alterations, stereo matrices and zincs for 15th 

Yearbook, Pt. Ill 277.67 

Printing 1200 copies 16th Yearbook, Pt. I ("Second 

Report Economy Time 7 ') 575.01 

Printing 1800 additional 16th Yearbook, Pt. 1 114.48 

Paper, alterations, stereo matrices and zincs for 16th 

Yearbook, Pt. I 420.68 

Distributing 15th Yearbook, Pt. Ill and 16th Yearbook, 

Pt. I (sent together) 111.15 

Printing 500 additional 6th Yearbook, Pt. II (" Kinder- 
garten") 87.92 

Printing 750 additional 9th Yearbook, Pt. I ("Health 

and Education") 95.24 

Printing 500 additional 10th Yearbook, Pt. I ("City 

School as Community Center") 56.06 

Printing 750 additional 10th Yearbook, Pt. II ("Rural 

School as Community Center") 63.85 

Printing 750 additional 13th Yearbook, Pt. II ("Orga- 
nizing School Surveys") 77.07 

Printing 1200 16ih Yearbook, Pt. II ("Size of High 

School and College Efficiency") 277.82 

Carried forward $2,582.87 
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Brought forward . . ...... - ..................... $2,582.87 

Paper, alterations, stereo matrices and zincs for 16th 

tfearbools, Pt. II ............................... 140 - 59 

Printing 300 additional 16th Yearbook, Pt. II ......... 28.76 

Distributing 16th Yearbook, Part II ................ . . 50.70 

Distributing 16th Yearbook, Pt. I (since March 1, 1917) 18.40 
Packing, cartage, freight, transferring Yearbooks and 

other materials from Chicago Press to Public School 

Publishing Company . , ........................ 5 *>.29 

Premium on fire insurance ($5,000) .................. 13.75 

Total cost of Yearbooks .................... $2891.36 

Secretary 9 * Office: 

Secretary's salary from end of Detroit meeting, Febru- 
ary, 1916, to end of Kansas City meeting, February, 
19 17 ... ................... . ....... ?. ......... $ 100.00 

Secretary's traveling and hotel expenses for Kansas City 

meeting ...................................... 55.93 

Bookkeeping and typewriting ....................... 72.75 

Other clerical assistance ............................ 17.50 

Stamps .......................................... 56.80 

Stationery ........................................ 36.00 

Telegrams ........................................ 1-78 

Total for Secretary's office .................. $ 340.76 

Total expenses ............................ $3232.12 

SUMMARY 

Total expenditures for 1917 ......... . .................... $3232.12 

-r-* -, T. ^ -r^ -u o-, -,iT ^Savings account... 2000.00 

Balance on hand December 31, 1917 : ] 0^^ account. . 97.47 



Total ...................................... $5329.59 



Number of active members (including three honorary) De- 
cember 31, 1917 280 

Number of associate members December 31, 1917 602 

Total membership 882 

Grur M. WHIPPLE, Becretcury-Treaswrer* 



ANNOUNCEMENT OF YEARBOOKS AND EXPLANATION 

OP MEMBERSHIP IN THE NATIONAL SOCIETY 

FOR THE STUDY OF EDUCATION 

The purpose of the National Society is to promote the investi- 
gation and discussion of educational questions. Anyone who is 
interested in receiving its publications may become a member. The 
Yearbooks are issued in several Parts each year and are discussed 
at the annual meeting, which is held in, February at the same time 
and place as the meeting of the Department of Superintendence 
of the National Education Association. There are two types of 
membership, associate and active. Associate members pay $1.00 
annually and receive one copy of each Yearbook. Active members 
pay $2.00 annually, receive two copies of each Yearbook, and are 
eligible to vote and hold office in the Society. 

The Yearbooks deal in a practical way with fundamental cur- 
rent issues in instruction and school administration. The Seven- 
teenth Yearbook (calendar year 1918) will comprise Part I, to 
contain the et Third Report of the Committee of the National Edu- 
cation Association on the Economy of Time," and Part II, to con- 
tain thirteen chapters on "The Measurement of Educational Pro- 
ducts," prepared by the National Association of Directors of Edu- 
cational Research. Both Part I and Part H may be expected in 
February, 1918. 

Orders for Yearbooks for 1917 or earlier or for single parts of 
fhe Yearbook, for 1918 are handled directly as commercial sales, by 
the Public School Publishing Co., Bloomington, Illinois, at the rates 
indicated on the cover of this monograph. To obtain the entire 
Yearbook for 1918 as a member of the Society, pin your check or 
postal order to the following slip, properly filled out, and mail to 
the Secretary now. 

APPLICATION FOR MEMBERSHIP 
To GUY M. WHIFFLE 

Secretary of fhe National Society for the Study of Education 
The University of Illinois, Urbana, Illinois 

active \ 

Please enroll me as an V member 

associate } 

( $2.00 as payment of active dues for calendar year 1918 
me ose j ^ 1 QQ ag pay^^t o f associate dues; for calendar year 1918 

Name . - 

Address to which 
to mail 
Yearbooks 
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EDITOB'S PBEFACE 

In prefacing Part I of the Sixteenth Yearbook it was stated 
that the policy of the Society to give preference in Its Yearbooks to 
contributions that would disseminate the reports of important com- 
mittees in advance of the meetings at which they are to be discussed 
had been favorably received both by members of the Society and by 
large numbers of the educational public. It was also stated as "not 
unlikely that other committees and organizations of men profes- 
sionally active in various aspects of educational endeavor will be 
glad to make similar use of the Society's avenues of publication in 
the future. * * This expectation has been realized in a most gratify- 
ing way in the Seventeenth Yearbook. I wish to congratulate mem- 
bers of the Society on this opportunity to serve themselves as well 
as the cause of education by cooperating with the National Associ- 
ation of Directors of Educational Research in the publication of the 
Yearbook these investigators have prepared. 

Gk M. WHIFFLE. 



COMMITTEE'S PBEFACE 

The National Association of Directors of Educational Be- 
seareh present this Yearbook on Educational Measurement to the 
superintendents and. teachers of American schools, hoping" that it 
may prove of practical value to them in their work. Its purpose is 
to gather into one handy volume a rather complete statement of the 
various aspects of a new movement which seems destined to have 
a profound and permanent influence upon American education. 
Each chapter has been written by a different member of the Associ- 
ation, and as in any new field of work, complete agreement in either 
theory or practice is not to be expected, so in this volume the careful 
reader will detect many evidences of healthy variations in ideals, 
aims and methods. However, it is believed that these differences 
are not serious enough to mar the unity of plan and content and 
that the book as a whole represents the best judgment of the Associ- 
ation as to what information is of greatest practical worth. The 
Yearbook is issued in the hope that it may further the cause for 
which the Association stands the promotion of educational re- 
search in American public schools. 

The editorial committee, on behalf of the Association, hereby 
gratefully acknowledges its indebtedness to the National Society for 
the Study of Education, whose cooperation has made the publica- 
tion of a yearbook possible. 

EDITORIAL COMMITTEE 
STTJABT A. COURTIS, Chairman, 
LEONABD P. AYHES, 
B. B. BUCKINGHAM, 



CHAPTER I 

HISTORY AND PRESENT STATUS OF 
EDUCATIONAL MEASUREMENTS 



P. 
Division of Education, RnsseH Sage Foundation^ New York City 



Measurements in education are fifty years old if we count from 
the oldest beginnings of wHeli we have record. They are twenty- 
five years old if we reckon from, the time that Dr Rice, the pioneer 
and pathmaker among American scientific students of education, 
began Ms work in this field. They are ten years old if we begin our 
count with the earliest efforts of Professor Thorndike, who is the 
father of the present movement. 

We are indebted to Professor Thorndike for having discov- 
ered what is apparently the earliest record of work in the field of 
educational measurements as we now use that term. As early as 
1864 a school master in England, the Rev. George Fisher, of the 
Greenwich Hospital School, had seen the need and possibilities of 
standards, and with prophetic foresight anticipated present-day 
achievements. His practice was as follows: "A book called the 
* Scale-Book' has been established, which contains the numbers as- 
signed to each degree of proficiency in the various subjects of exam- 
ination : for instance, if it be required to determine the numerical 
equivalent corresponding to any specimen of 'writing,' a compari- 
son is made with the various standard specimens, which are 
arranged in this book in order of merit; the highest being repre- 
sented, by the number 1, and the lowest by 5, and the intermediate 
values by affixing to these numbers the fractions %, %, or %. So 
long as these standard specimens are preserved in the institution, 
so long will instant numerical values for proficiency in 'writing' be 
maintained. And since f ac-similes can be multiplied without limit, 
the same principle might be generally adopted. 

"The numerical values for ' spelling * follow the same order 
and are made to depend upon the percentage of mistakes in writing 
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from dictation sentences from works selected for the purpose, exam- 
ples of which are contained in the * Scale-Book/ in order to preserve 
the same standard of difficulty* 

"By a similar process values are assigned for proficiency in 
mathematics, navigation, Scripture, knowledge, grammar and com- 
position, French, general history, drawing, and practical science, 
respectively. Questions in each of these subjects are contained in 
the c Scale-Book, ' to serve as types, not only of the difficulty, but of 
the nature of the questions, for the sake of future reference; observ- 
ing that the same numerals are used in the same order as before, viz., 
number 1 denotes the highest, and number 5 the lowest amount 
of attainment. 

"In respect to the numerical values of 'reading/ as regards 
accuracy, taste or judgment, it is obvious that no other standard of 
measurement can be applied, beyond the interpretation of the terms 
'good/ 'bad/ 'indifferent/ etc., existing at the period of examin- 
ation. And the same observation will apply to the estimation of 
numbers of 'characters' and 'natural abilities/ as determined by 
the united testimony of the respective masters. 

"Having stated this much with regard to the plan pursued in 
this school, I may well add that the advantage derived from this 
numerical mode of valuation, as applied to educational subjects, is 
not confined to its being a concise method of registration, combined 
with a useful approximation to a fixed standard of estimation, appli- 
cable to each boy; but it affords also a means of determining the 
sum total, and therefrom the means or average condition or value 
of any given number of results. >?1 

Mr. Fisher's efforts seem to have produced no lasting results. 
Progress in the scientific study of education was not possible until 
people could be brought to realize that human behavior was suscep- 
tible of quantitative study, and until they had statistical methods 
with which to carry on their investigations. Both of these were 
contributed in large measure by Sir Francis G-alton. As early as 
1875 he published scientific studies of the traits of twins, of number- 



by E. B. Chadwick in the Museum, a Quarterly Magaewe of 
Education, Literature <md Science, Vol. HI, 1864. See also Journal of Educa- 
tional Psychology, Vol. 4, page 551. 
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forms, of color-blindness, and of the efficacy of prayer. Out of Ms 
work came much, of experimental and educational psychology, and 
indirectly, educational measurements. It was he who developed the 
statistical methods necessary for the quantitative study of material 
which seemed at the outset entirely qualitative and not at all numer- 
ical in nature. 

In America the real inventor of the comparative test was Dr. 
J. 11. Bice. Dr. Bice studied in Germany and came under the influ- 
ence of the German psychologists at Jena and Leipsic. Returning 
to this country, he became interested in education and one day in 
1894 the new idea was bom. Of this invention Dr. Bice says : "In 
truth, however, I came to recognize that this (the claims of school 
men following different courses of study) was all talk, that no one 
really knew the facts, because there were no standards to serve as 
guides. Then one day, the idea flashed through my mind that the 
way to settle the question was to try it out. For a beginning I de- 
cided to take spelling, and on that very day I made up a list of 50 
words with the view of giving them as a test to the pupils of the 
schools as I went on my tour from town to town. I have no record 
of the date of the inspiration, but I think it was some time in Octo- 
ber, 1894. " 

Dr. Bice's work, however, did not meet with the approval of 
the educators of the day. One of his earlier reports in this field 
indicated that children who had spent thirty minutes a day for 
eight years in the study of spelling did not at the end of that time 
speE any better than the children in another school system who had 
spent only fifteen minutes a day for eight years in the same study. 
The presentation of these results brought upon the investigator 
almost unlimited attack. The educators who discussed Ms findings 
and those who reviewed them in the educational press united in 
denouncing as foolish, reprehensible, and from, every point of view 
indefensible, the effort to discover anything about the value of the 
teaching of spelling by finding out whether or not the children could 
spell. They claimed that the object of such work was not to teach 
children to spell, but to develop their minds ! It was the issue be- 
tween the investigator and the formalist in education, and the con- 
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flict that Is still under way is the conflict that was then for tlie first 
time clearly defined. 

Little by little the more thoughtful men in the field of educa- 
tion appreciated the suggestive value of Dr. Bice's work and some 
few of them, notably Professor Hanus of Harvard, dared to come to 
Ms support. Slowly the tide turned in his favor, until by common 
consent the general validity of his conclusions was tentatively ac- 
cepted. His methods, however, were not generally adopted, and 
for more than ten years -but little progress was made beyond the 
work of the pioneer himself. 

If Dr. Bice is to be called the inventor of educational measure- 
ment, Professor E. L. Thorndike should be called the father of the 
movement. In 1895, Professor Thorndike was a student at Col- 
umbia, struggling with statistical methods in a course on measure- 
ments under Boas, and "finding it new and very hard for me to 
learn. ' ?2 His interests were in the field of psychology and the work 
of Bice made a deep and lasting impression. Gradually his experi- 
mental work came more and more into the educational field. He 
began to preach the need of measurement and to experiment with 
tests and scales. The Stone Arithmetic Tests were published in 1908. 
The Thorndike Scale for the measurement of merit in handwriting 
was presented before Section L of the American Association for the 
Advancement of Science at its Boston meeting, in December, 1909, 
and was published in the Teachers College Record the following 
March. The construction of this scale, based on the equal difference 
theorem formulated by Cattell, marks the real beginning of the sci- 
entific measurement of educational products. 

During the past ten years the growth of the scientific movement 
in education has been continuous and rapid. It has been closely 
related to the survey movement which had its real inception in 1907 
in a great social study of the city of Pittsburgh, which was termed 
"A Survey. 77 Three years later two college professors, Hanus of 
Harvard and Moore of Yale, conducted studies of the school systems 
of Montclair and East Orange in New Jersey. These studies dif- 
fered from earlier investigations of school systems in that their 
purpose was to tell the public about their public schools, and each 

Quotation from a personal letter. 
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investigator, borrowing the term from tlie contemporary social 
movement, used the word "survey" to designate a section of Ms 
report. In the years that have followed, scores of surveys of city, 
state and county school systems have been conducted, and in ever 
increasing degree they have utilized, as perhaps the most important 
of their methods, the scales and tests used in the measurement of 
educational processes and products. 

The two movements were represented in the New York school 
inquiry of 1911-12. For the first time in a formal educational in- 
vestigation tests were used as an aid in evaluating the results of 
public-school work. These were the Courtis arithmetic tests, wMch 
had by that time attracted a good deal of attention. Their success- 
ful use in the New York survey not only settled all doubts as to the 
availability of the tests themselves for the measurement of educa- 
tional attainment, but also firmly established the principle that in 
conducting school surveys scientific tests must be utilized where 
they are available. 

One of the recommendations of the survey committee in New 
York City was that a Bureau of Research be established to conduct 
a continuous survey, from within the school system itself and for its 
benefit. TMs recommendation was immediately adopted and the 
Bureau organized in September, 1912. Previous to tMs time, there 
had been in various cities committees and other organizations, which 
had made studies of various phases of administrative and instruc- 
tional work, but to New York City probably belongs the credit of 
first establisMng a formal organization having for its purpose the 
continuous critical study of its own activities by scientific methods. 

By tMs time, Boston, Detroit, and many other cities, were ex- 
perimenting with measurement and obtaining results of value. 
Other bureaus were soon established. Thei Division of Education of 
the Russell Sage Foundation had turned its attention to work of this 
type as early as 1907, the Boston Bureau was organized in 1913, 
and similar organizations in Detroit, Kansas City, and Oakland 
soon followed. During these same years faith and interest in meas- 
urements had been greatly stimulated by the development of the 
Binet-Simon tests and by the wide-spread attention given the study 
of retardation and elimination in school systems. A demand for 
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men trained for the work was created Superintendents and teach- 
ers also were clamoring for technical knowledge of methods and for 
explanations of the results obtained. For ten years graduates of 
Teachers College, Columbia University, and of the School of Edu- 
cation of Chicago University had had impressed upon them that 
measurement and scientific experimentation were highly desirable 
in education and they had been at least partly prepared for such 
work. Next, this training was expanded into formal courses in edu- 
cational measurement. Soon courses in measurement appeared in all 
the great universities and the movement began to gain full momen- 
tum. 

The meetings of the Department of Superintendence of the 
National Education Association afford an excellent index of the 
progress of the movement. Dr. Rice's report in 1897 was received 
with derision. The Philadelphia meeting in 1912, after a heated 
discussion, voted against measurement by a small majority, but two 
years later a committee on Tests and Standards made a favorable 
report which was adopted by a considerable majority. 

Today tests and scales are used throughout this country and 
around the world. In England, Germany, and France, before the 
war, beginnings had been made. Scales for the measurement of 
Chinese writing and composition are now in process of construction. 
In Australia and New Zealand, in India and Hawaii, and through- 
out the length and breadth of the United States and Canada, tests 
and scales are in daily service, proving valuable tools in the hands 
of those who know how to use them. 

The scientific method is at base analytic scrutiny, exact meas- 
uring, careful recording, and judgment on the basis of observed 
fact. Science in education is not a body of information, but a 
method, and its object is to find out and| to learn how. By its aid, 
education is becoming a profession. Courses of study are being 
adapted to the needs of children; teaching effort and supervisory' 
control are becoming more efficient. .The center of interest in edu- 
cation has become the child, rather than the teacher, and efforts to 
improve the quality of instruction begin by finding out what the 
children can do, rather than by discussing the methods by which the 
teacher proceeds. 
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Educational measurement lias been accepted by the American 
public. This Yearbook is in itself a proof of that. That the meth- 
ods of today are still crude and imperfect must be admitted by even 
the most enthusiastic supporters of the movement. They deal most 
effectively with only the simple mechanical skills, and even here 
they are still far from perfect. Nevertheless, they are extending 
each year their range of availability and their field of application. 

The importance of the movement lies not only in its past and 
present achievements, but in the hope of the future. Knowledge is 
replacing opinion, and evidence is supplanting guess-work in edu- 
cation as in every other field of human activity. This is the su- 
preme fact to which this Yearbook bears witness. The future de- 
pends upon the skill, the wisdom, and the sagacity of the school men 
and women of America. It is well that they should set about the 
task of enlarging, perfecting, and carrying forward the scientific 
movement in education, for the great war lias marked the end of 
the age of haphazard, and the developments of coming years will 
show that this is true in education as in every other organized field 
of human endeavor. 



CHAPTER II 

THE NATURE, PURPOSES, AND GENERAL METHODS OF 
MEASUREMENTS OF EDUCATIONAL PRODUCTS 



L. THOBNDIKE 
Professor of Educational Psychology, Teachers College, Columbia University 

Whatever exists at all exists in some amount. To know it 
thoroughly involves knowing its quantity as well as its quality. 
Education is concerned with changes in human beings; a change 
is a difference between two conditions ; each of these conditions is 
known to us only by the products produced by it things made, 
words spoken, acts performed, and the like. To measure any of 
these products means to define its amount in some way so that com- 
petent persons will know how large it is, better than they would 
without measurement. To measure a product well means so to de- 
fine its amount that competent persons will know how large it is, 
with some precision, and that this knowledge may be conveniently 
rcorded and used. This is the general Credo of those who, in the 
last decade, have been busy trying to extend and improve measure- 
ments of educational products. 1 

We have faith that whatever people now measure crudely by 
mere descriptive words, helped out by the comparative and superla- 
tive forms, can be measured more precisely and conveniently if in- 
genuity and labor are set at the task. We have faith also that the 
objective products produced, rather than the inner condition of the 
person whence they spring, are the proper point of attack for the 
measurer, at least in our day and generation. 

This is obviously the same general creed j as that of the physicist 
or chemist or physiologist engaged in quantitative thinking the 
same, indeed, as that of modern science in general. And, in general, 

a The conditions to be thoroughly known must be known as quantities a, b t 
e, d 9 etc,, of qualities, or powers, or skills, or knowledges A, &, T, J, etc. that 
is, as an equation aA-^-fiB-^cY, etc. 
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the nature of educational measurements is the same as that of 
all scientific measurements. 

In detail, however, there are notable differences. An educa- 
tional product, such as a composition written, a solution of a prob- 
lem in arithmetic, an answer to a question about history, a drawing 
of a house or the performance of an errand, is commonly a complex 
of many sorts of things. The task of measuring it seems more like 
measuring a house or an elephant than it is like measuring a length 
or a volume or a weight A complete measurement of, say, a composi- 
tion might include an exact definition of its spelling, its usage of 
words, its usage of word forms, its wit, its good sense and so on and 
on ; and each of these might again be subdivided into a score or more 
of component elements. 

What we do, of course, is to make not such a complete meas- 
urement of the total fact, but to measure the amount of some fea- 
ture, e.g., the general merit of the composition or the richness of its 
vocabulary, just as physical science does not measure the elephant, 
but M$ height, or his weight, or his health, or his strength of pull. 
Every measurement represents a highly partial and abstract treat- 
ment of the product. This is not understood by some of our critics 
who object to tests and scales because of their limited point of view. 
The critic's real point should be that an educational product com- 
monly invites hundreds of measurements, as we all well know. It 
should be noted also that single measurements are still in a sense 
complex, being comparable to volume, wattage or the opsonie index, 
rather than to length, weight or temperature. 

In the second place, the zeros of the scales for the educational 
measures and the equivalence of their units are only imperfectly 
known. As a consequence, we can add, subtract, multiply and di- 
vide educational quantities with much less surety and precision than 
is desirable. Indeed, in any given ease, the sense in which one edu- 
cational product is twice as good or as desirable as another, or in 
which one task is twice as hard as another, or in which one improve- 
ment is twice as great as another, is likely to be a rather intricate and 
subtle matter, involving presuppositions which must be kept in 
mind in any inferences from the comparison. 
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In some eases so little Is known of units of amount that we do 
not even try to equate distances along the scale, but simply express 
relative size in terms of arbitrarily eliosen units and reference 
points. 2 This is the case, for example, with the most commonly 
used measurement in psychology and education, that due to apply- 
ing the Binet-Simon tests. 

Nobody need be disturbed at these unfavorable contrasts be- 
tween measurements of educational products and measurements 
of mass, density, velocity, temperature, quantity of electricity, and 
the like. The zero of temperature was located only a few years 
ago, and the equality of the units of the temperature-scale rests 
upon rather intricate and subtle presuppositions. At least, I ven- 
ture to assert that not one in four of, say, the judges of the supreme 
court, bishops of our churches, and governors of our states could 
tell clearly and adequately what these presuppositions are. Our 
measurements of educational products would not at present be en- 
tirely safe grounds on which to extol or condemn a system of teach- 
ing reading or arithmetic, but many of them are far superior to 
the measurements whereby our courts of law decide that one trade- 
mark is an infringement on another. 

.There are two somewhat distinct groups of educational meas- 
urements: one, well illustrated by the Courtis tests, asks primarily 
how well a pupil performs a certain uniform task ; the other, well 
illustrated by the Hillegas or Trabue tests, asks primarily how hard 
a task a pupil can perform with substantial perfection, or with some 
other specified degree of success. The former are allied to the so- 
called method of average error of the psychologists; the latter, to 
what used to be called the method of "right and wrong cases." 
Each of these groups of methods has its advantages, and each de- 
serves extension and refinement, though the latter seems to repre- 
sent the type which will prevail if education follows the course of 
development of the physical sciences. 

I have so far omitted specific reference to measurements By 
relative position the so-called 'order of merit method.' This 
method, available even where no differences in the amount of the 



2 Tliat is, as a, o+a?, a-^x-^y, a-^-x-^-y+s, etc., claiming only that a?, y, and 
& are all positive quantities. 
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thing measured are defined, and useful to organize the reports of 
untrained observers, is doing excellent service as a first stage in 
quantitative knowledge. For every reason, however, the grading 
of a set of educational products by relative position should soon 
give way to their rating by some even rough scale, such as meteor- 
ology uses for the cloudiness of days, and such as astronomers use 
for the magnitude of stars. A very, very simple form of scale, such 
as almost anybody can use to measure almost any product that he 
knows anything about^ is that devised by Walter Dill Scott for use 
in rating the achievements or promise of employees. 3 

The purpose of measurements of educational products is in 
general to provide somebody with the knowledge that he needs of the 
amount 'of some thing, difference or relation. The " somebody ?y may 
be a scientific worker, a superintendent of schools, a teacher, a pa- 
rent or a pupil. He may need a very precise or only an approxi- 
mate measure, according to the magnitude of the difference Which he 
has to determine. He may need it for guidance in many different 
sorts of decisions and actions. 

Some of the most notable uses concern the values of studies 
in terms of the changes produced by them, the effects of different 
methods of teaching, and the effects of various features of a school 
system, such as the salary scale, the length of the school day and 
year, the system of examining and promoting pupils, or the size of 
class. There are many problems under each of these heads, and 
each of these problems is multifarious according to the nature, age, 
home life and the like of the pupils, and according to the general 
constitution of* the educational enterprise, some small feature of 
which is being studied. 

Another important group of uses concerns inventories of the 
achievements of certain total educational enterprises such as our 
educational surveys must become if they are to carry authority with 
scientific men. The total educational enterprise may be the work 



"The Bating Scale was originally devised and is now issued as one of the 
copyrighted forms of the Bureau of Salesmanship Research, Carnegie Institute 
of Technology, Pittsburgh, Pa. A modification of it is in use in certain sec- 
tions of the military organization of the United States for the selection of men 
for promotion. A description of this military modification has appeared in 
ColMer's Weekly^. M. W. 
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of a teacher, of a school, of an orphanage, of a prison, of a system 
of schools, or the like. 

Another important group of uses centers around the problem 
of giving the individual pupil the information about his own 
achievement and improvement which he needs as a motive and a 
guide. It is interesting to note that the first of the newer educa- 
tional scales, which was expected to be used chiefly by scientific in- 
vestigators of the teaching of handwriting, now hangs on the wall 
of thousands of classrooms as a means for pupils to measure them- 
selves. There are many other purposes, and important ones, such 
as the detection and removal of gross prejudices on the part of 
teachers in their own evaluations of certain educational aims and 
products. These,however, cannot be described here. 

The superintendents, supervisors, principals and teachers di- 
rectly in charge of educational affairs have been so appreciative of 
educational measurements and so sincere in their desire to have 
tests and scales devised which they can themselves apply, that the 
tendency at present is very strong to provide means of measurement 
which are concerned somewhat closely with school achievements, 
and which can be used by teachers and others with little technical 
training. There is also a tendency, because of "this need for a large 
number of measurements in the case of educational problems, to 
try to devise tests which can be scored by persons utterly devoid of 
judgment concerning the products in question. 

It would ill become the present writer to protest against these 
two tendencies ; and they are intrinsically healthy; There is, how- 
ever, a real danger in sacrificing soundness of principle and pre- 
cision of result to the demand that we measure matters of import- 
ance and measure them without requiring elaborate technique or 
much time of the measurer. The danger is that the attention of 
investigators will be distracted from the problems of pure measure- 
ment for measurement's sake, which are a chief source of progress 
in measuring anything. Perhaps not even one person in a million 
need feel this passion, but for that one to cherish it and serve it 
is far more important than for him to devise a test which thousands 
of teachers will employ. Opposition, neglect, and misunderstand- 
ing will be much less disastrous to the work of quantitative science 
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in education than a vast output of mediocre tests for measuring 
this, that and tie otter school product, of which a large percent 
are fundamentally unsound. 

We have seen that educational measurements vary from an 
assignment of a certain amount of some clearly defined thing, the 
zero, or " just not any/* of which, is fairly accurately known, to 
a mere assignment of a certain position in a series of products them- 
selves only similarly defined. They vary also from measurements 
in the most unimpeachable of units, such as time, to measurements 
where the unit is "that difference in quality which 75 percent of 
a certain sort of observers succeed in observing" or is even more 
crudely and hypothetically defined. They include measures in 
the form of how well a certain task is performed, and of how hard 
a task can be performed with a certain degree of success. Conse- 
quently, the methods of devising and using educational measure- 
ments also vary widely too widely for any unified exposition. 
What will be said about methods here will, in fact, comprise only 
certain recommendations and cautions which are likely to be often 
appropriate. 

Consider first certain principles of method designed to ensure 
reliable measures, or at least measures whose degree of unreliability 
is known and can be allowed for. These are : 

At least two specimens or samples should be taken of any fact 
about which, a statement is to be made. If any individual's achieve- 
ment in drawing is to be reported, use at least two drawings. If 
the achievement *of a class in addition is to be reported, use at least 
two tests, preferably on two days. If the effect of a method is to 
be estimated, test the method with, at least two classes taught by 
different teachers. If the quality of a specimen of handwriting is 
to be reported, have at least two judges rate it independently. It 
will often appear from the comparison of two samplings of a fact 
that many more samplings are needed to permit a statement that is 
precise enough, for the purpose in view. 

No fixed rules can be given, since tlie purpose in view deter- 
mines the degree of precision that is required, but it may be noted 
that a test which gives, for a single pupil, an approximation so 
rough as to be almost useless, gives for a class of thirty-six a result 
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which is six times aa.preeise, and for a group of nine classes a result 
which is eighteen times as precise. Ten times as large a sampling 
of the product in question is required to measure a single pupil as 
to measure the average of a hundred pupils (to the same degree of 
precision). In general, eight tests of 15 minutes each are superior 
to four tests of 30 minutes each, and still more superior to two tests 
of 60 minutes each, since the accidents of particular temporary cir- 
cumstances are thus reduced in influence. 

Consider next certain principles of method that need to be oh- 
served if we are to secure measures whose significance is certain. 

Great care should be taken in deciding anything about the fate 
of pupils, the value of methods, the achievement of school systems 
and the like from the scores made in a test, unless the significance 
of the test has been determined from its correlations. For example, 
it cannot be taken for granted that a high score in checking letters 
or numbers is significant of a high degree of accuracy and thorough- 
ness in general. Letter-cheeking tests have been so used, but with 
very little justification. Courtis has given reason to believe that a 
test with stock problems from text-books in arithmetic may be a very 
inadequate test of ability to reason with quantitative facts and re- 
lations, this ability being in such a test complicated by, and perhaps 
even swamped by, the ability to understand the verbal description 
of the facts and relations. 

A pupil's score in a test signifies first, such and such a particu- 
lar achievement, and second, only whatever lias 'been demonstrated 
*by actual correlations to he implied ~by it. Nothing should be taken 
for granted. 

The significance of one ability (A) for dnother (5), is given 
by the correlation coefficient r AB corrected for attenuation. The 
significance of a particular test sampling (A) for the ability (B) 
is given by the raw correlation coefficient T AB . Thus, arithmetical 
ability itself is significant to a high degree of promise of ability with 
algebra and geometry, but a five-minute test in arithmetic would 
be much less so. 
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It is unf ortnnately the case that we do not at present know 
at all well the significance of any school ability or of any of the 
tests which we have devised as convenient means of sampling abil- 
ities. We need not blame ourselves for* this : the educational meas- 
urements now in use are much better than none at all. They do 
excellent service, provided inferences are made with proper caution. 
They will do still better service in proportion as the correlations 
of each are determined. This work is extremely laborious, but 
sound method requires it. 

Consider next certain principles of method designed to free 
measurements from certain pernicious disturbing factors, notably 
unfair preparation for the test, inequalities in interest and effort, 
and inequalities in understanding what the task is. 

The best protection against unfair preparation is the provision 
of many alternative tasks of demonstrated equality in difficulty. 
This again means extremely laborious and uninteresting work, 
which nevertheless requires expert talent. It should be subsidized. 

There is and can be no absolute assurance of equality in interest 
and effort. Any educational product is a product of ability condi- 
tioned by interest. All that we can do is to choose such conditions 
for the test as are found to reduce inequalities in interest and effort 
to a minimum (that is, to show high correlations with the composite 
of results obtained with a sampling of all conditions likely to influ- 
ence interest). There is reason to believe that, when the test is 
taken as a part of school work, the appeal to group competition, as in 
4 'We wish to find out whether you can do as well as the sixth-grade 
children in Boston did," and a promise to report the results to 
each individual, are useful. In the case of high-school and college 
students a small payment in money or release from tasks, together 
with the promise of a full report to each individual, seems a useful 
method. 

Inequalities in understanding what the task is, may be reduced 
by a preliminary trial, identical in form with the test itself, but 
with very easy content, and by giving 1 special tuition to any pupil 
who fails in this preliminary trial. Instructions should be in simple 
language and should always be accompanied by at least three con- 
crete samples of the task. 
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One who is to find imperfections can. find many in present 

of educational products. Nor is it a hard task to make 
constructive suggestions for improvement. An intelligent stu- 
dent of education could probably in a single day note a score of 
ways of improving the scales and tests winch, we now use. 
That is really child's play. The hard thing is the actual expert 
work of remedying the imperfection, for this involves hundreds of 
hours of detailed expert planning, experimenting and computing. 
What is needed in educational measurement is not the utterance by 
onlookers of criticisms and suggestions with which the men actually 
at work with measurements are as familiar as they are with their 
own names, but expert assistance in overcoming the defect. 

If those who object to quantitative thinking in education will 
set themselves at work to understand it; if those who criticise its 
presuppositions and methods will do actual experimental work to 
improve its general logic and detailed procedure; if those who are 
now at work in devising and in using means of measurement will 
continue their work, the next decade will bring sure gains in both 
theory and practice. Of the gains made in the past decade, we may 
well be proud. 



CHAPTER HI 

SPECIFIC USES OF MEASUREMENT IN THE SOLUTION 
OF SCHOOL FEOBLEMS 



M. E. HAGQBETY 

Director, Bureau of Cooperative Besearch, University of Minnesota 



In preparing this chapter on the speeifie uses of measure- 
ment in the solution of school problems the writer mailed to a se- 
lected gronp of school superintendents, most of whom were known 
to have used tests and scales, a questionnaire. Chiefly it was sought 
to learn what changes in school organization and procedure had been 
made as a result of such measurement. 

Among 200 replies received there were 62 which reported some 
conscious alteration in the work of the school following the use of a 
standardized scale or test. In general, these changes may be 
grouped under six heads as follows: 

1. Changes in classification of pupils 

2. Changes in school organization 

3. Changes in course of study 

4. Changes in methods of instruction - 

5. Changes in time devoted to subject 

6. Changes in methods of supervision 

Under these same headtf it is convenient to group the remedial 
measures described in the periodical literature, and the discussion 
to follow will, therefore, make use of this classification. Under each 
head will be given results of the questionnaire. These results are 
fragmentary, but serve to indicate the range of things which school 
officers wisely or unwisely do as a result of information derived 
from educational measurements. Under each head will also be 
given one or more detailed examples of the "type of remedial work in 
No attempt is here made to give an exhaustive review of 
5 &<-i * * i 'tre. Only suggestive cases are used. 

25 
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L CLASSIFICATION OF PUPILS 

1. Indicated by Replies to Questionnaire 

In were of three sorts : 

(a) The promotion and demotion of individual pnpHs who 

were improperly classified. "We gave certain pupils double 

promotions." ""We demoted and promoted pupils who did not fit 

the they were In. ' * " Bright pupils were put Into relief by the 

and afterwards examined; a large number were promoted 

thus." 

(6) A transfer of pupils from one grade to another for par- 
ticular subjects. "Pupils were transferred in reading to grades for 
which the tests revealed they were fitted/' "When pupils reached 
Quality 10, Thorndike handwriting scale, In monthly tests they were 
promoted Into advanced section, meeting three times a week/' "Pu- 
pils classified in reading according to score in test : (1) those below 
Kansas Standard drilled in thought Interpretation ; (2) those who 
equalled Kansas median given no extra attention; (3) those who 
tested a grade higher aEowed to drop reading for a time and work 
on any study they were low in." 

(c) A general reclassification of entire school. "I classified 
my school below seventh grade so pupils could make up work where 
they were weak and take advanced work where they were strong/' 
2. Detailed Example 

In the University of Minnesota High School 60 pupils were ac- 
cepted at the opening of the school year as beginners in the fresh- 
man class. These students were required to take English and gen- 
eral science and had a choice of two of the following: Latin, an- 
cient history, and mathematics. Before the first day of school they 
were tested, as a group, with the Trabue completion scale, an anal- 
ogies test, and an omnibus mental test. Later they were tested with 
Thorndike 's reading scale Alpha 2, a series of arithmetical prob- 
lems, and a wide range of mental and educational tests. The in- 
itial tests were given in order to get a measure of the probable suc- 
cess of the several students and to find an intelligible basis for sec- 
tioning the group for purposes of instruction. On the basis of the 
test scores, the students were divided into two or more classes for 
the several school subjects. 
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The school marks for these students were given in all by seven 
instructors ; each student was rated by four different teachers. The 
marks were in letters A, B 9 G, T) and F and were based upon, a rel- 
ative marking system. In the total marks to be here considered A 
was given to 8.6 percent of the class, B to 21.2 percent, C to 43.3 
percent, D to 20 percent and F to 6.8 percent. In the work in gen- 
eral science^ where two sections were taught by different teachers; 
the instructors conferred in giving the marks, so that the sixty 
pupils were rated as a single group. This rating was in large meas- 
ure on the basis of objective tests which were the same for all. Sim- 
ilar objective tests were used in all subjects. 

The marks to be here considered are those given at the end of 
the first month. These marks, more than those to be given later, 
are liable to inaccuracy as indicators of ability to do the high-school 
work. Now, comparing these marks 1 with the scores in the standard 
tests, what do we find! 

The first and simplest measure of prophecy which we wish to 
find is the median attainment, for sixty pupils can be fairly divided 
into two sections for high-school instruction. If, by dividing them 
on the basis of the tests, we get the more capable half in the upper 
section and the less capable half ia the lower section, the prophecy 
of the tests is confirmed. Figuring the median attainment, we find 
that the omnibus test placed 72 percent of the sixty pupils in that 
half of the class in which they were placed by the teachers 7 marks 
for the first month. Likewise, the reading scale Alpha 2 placed 72 
percent correctly. When the- scores of the two tests are combined 
the median retention is 76 percent. In other words, the tests placed 
more than seven 'pupils in every ten correctly before they had done 
a single day of high-school work. 

As a matter of fact, the prognosis was even better than this, for 
all of the instructors were agreed that the school marks did not rep- 
resent the abilities of all of the pupils accurately. Thus, one boy 
of acknowledged ability stood 12 in the omnibus test and 22 in the 
reading test. In marks he stood 57, scoring C in history and fail- 
ing in general science, mathematics and English. Every one, in- 



*These data are available through the eonrtesy of 3>r. W. S. Miller, Prin- 
cipal of the University of Minnesota High School. 
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the boy that this month lie Idled 

Ms There Is also the opposite type of case a student 

low in the tests but by rausual Industry lifted himself above 
the Hue In marls. When one considers the part which in- 

dustry and the variable factors of outside work, social dis- 

tractions, Interests and personal attitudes In relation to 

achievement, it Is clear that Intellectual ability alone Is not 
determinative. 

It Is encouraging to believe, however, that approximately eight 
in ten are properly placed by such tests. This idea is 
supported by figuring the average mark of the students in the upper 
and lower halves of the tests. Equating the letters to the figures 
5, 4 3 3, 2 and 1, it Is evident that a student carrying four subjects 
could score 20 points. As a matter of fact the upper half as divided 
by reading test scored 13.4 points, while the lower half scored 10.3, 
and similar figures for the two groups as divided by the omnibus 
test are 13.5 and 10.2. If we divide the sixty pupils Into three equal 
groups on tie basis of the two tests, the upper third averages 14.2 
in marks, with no failures in a total of eighty marks. The lower 
third averages 9.8 with 17 failures in a total of eighty marks and 
only 9 marks above C. 

Seasoning from all these data, it is safe to say that both edu- 
cational and mental tests may be used tof classify students for pur- 
poses of instruction ; that a few hours spent in preliminary exam- 
ination will foreshadow later achievements to a high degree. Ad- 
mittedly, much technique remains to be developed, but the prom- 
ise is sure. Superior students can be detected and grouped to- 
gether; mediocre students can be put with mediocre students, and 
weak students, Instead of being submerged in the struggle to main- 
tain standing, can receive the help they need. It would be difficult 
to overestimate the increase of efficiency that would com from the 
better adaptation of instruction in consequence of such classifica- 
tion. 

How dependable the tests really are in promoting superior 
students is evidenced by numerous insptances, of which the following 
may serve as an example : 
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Robert was 12 years old, beginning second semester of eighth, 
grade. His teachers reported Mm Indifferent, doing only ordinary 
work and inclined to be the center of schoolroom disorder and or- 
ganized insurrection* Parents noted that, though previously much 
interested in school, the boy now disliked to attend ; he disliked the 
teachers and wanted to drop out. Robert insisted that the studies 
were not interesting that he knew all he wanted to know about them 
already. Mental examination showed an intelligence quotient of 
142, a mental age probably greater than that of some of Ms teach- 
ers, who bored Mm to death by treating him as an ordinary twelve- 
year-old. He was recommended to Mgh school, entered three weeks 
late, led his class at the end of six weeks and at every subsequent 
interval when marks were given. More important, his whole atti- 
tude toward school was changed, because the advanced work was a 
real challenge to Ms mental ability. 

II. SCHOOL ORGANIZATION 

1. Changes Indicated by Replies to Questionnaire 

Seven types of change in school organization were indicated 
as follows: 

(&) Change in size of classes. "Smaller classes in arithme- 
tic. " " More teachers in arithmetic. " " The services of additional 
teachers demanded for defectives in industrial training." "En- 
largement of class for defectives/' 

(6) Division of classes into special sections. "An advanced 
and a special section made in writing on the basis of errors. " 

(c) Organization of Special Classes. "Opened special room 
for backward pupils. " "Organized special corrective work." 

($) Departmentalization. "Departmentalization of sixth, 
seventh, and eight grades." "Department teaching." 

(e) Arrangement of parallel programs. "Spelling periods 
for different grades arranged for same time to permit transfer of 
brighter pupils." "Same for reading." 

(/) Appointment of supervisors and supervising principal. 
"Position of supervising principal for primary grades created." 
"Appointed a director for a newly organized Bureau of Research." 
"Plan to hire a trained supervisor for writing next year." 

(g) Inauguration of special schools, "An initial attempt 
to develop an elementary industrial school for pupils shown by the 
tests to be unfitted for the regular work. ' ' 
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3. Detailed Examples 

(a) Programs. At the Lake Harriet School in Min- 

neapolis a by the Ayres scale showed a wide distribu- 

tion of the pupils of each class. In the 

8A 43.3 of the children were of eighth-grade spelling 

ability. Grouped along with, them were 26.7 percent of seventh- 
ability, 26.7 percent of sixth-grade ability and 3.3 percent of 
ability, liore variable than this was the fifth-grade 
where the distribution showed every level of ability from the 
to the eighth grade. On the basis of this showing, Miss 
Probst, tie principal, observed that it was practically impossible in 
group instruction "to devise a spelling lesson which would tax the 
capacity of each, individual in the group/ 7 It was determined, 
therefore, to rearrange the grouping in such manner as to give every 
child "capacity work." To justify this regrading, further tests were 
given. With the results of all the tests as a basis, the pupils were 
redistributed so that those of like ability recited together. In the 
new organization the original 7B class retained four pupils from 
an original total of thirty-two. The others were distributed to new 
groups as follows: seven to 8A, six to 8B ? thirteen to 7 A and four 
to the sixth grade. To the new 8B group, the several grades contrib- 
uted in this fashion: 8 A gave 7 pupils; 8B gave 14; 7 A gave 4; 7B 
gave 6; the sixth grade gave 6; the fifth grade gave 5, and the 
fourth grade one a total of 42. 

, When the redistribution of the pupils on the basis of ability 
had been made, the spelling recitations for all were arranged to take 
place between 11 :45 and 12 :00 o'clock on each day. At the sound 
of the bell, each pupil passed to the room where his particular level 
of work was in progress. There he would go each day until a defin- 
ite change in Ms work occurred. If the average of his work for two 
consecutive weeks should fall below 90 percent, he automatically 
gravitated to the grade below. If he maintained a standard of 99 
percent for four successive weeks, he was promoted to the grade 
above. To illustrate : two 8B boys whose beginning record showed 
about 65 percent dropped back to the fifth grade. Unable to main- 
tain the pace of tMs grade, they dropped back to the fourth. 
"Here," to quote Mss Probst, "they evidently found their spell- 
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ing level, for they took a fresh start, were promoted to the fifth 

grade^ then to the sixth and finally to the 7B group." 

The cMef outstanding result of the experiment was a very great 
diminution of the variability in the several grades. Whereas in 
the first test but 43.3 percent of the 8A pupils had eighth-grade 
spelling ability or better, 71.4 percent came up to this standard in 
the second test in Hay. In the 7A elass ? the corresponding figures 
were 45 and 80 : in the sixth grade they were 55 and 90. 

(6) Special Classes in Scliools. A second change in school 
organkation brought about by means of educational and mental 
tests is the institution of special classes for the education of excep- 
tional children. Wallin reports (1914) eleven types of such classes. 
(c) Organization of Bureaus of Research. Probably the most 
significant change in school organization growing out of the meas- 
urement movement is the organization of Bureaus of Research as 
a supplementary supervisory and administrative agency. Since 
this topic is treated at length in other chapters of this report an ex- 
tended statement is unnecessary at this place. 

III. COURSE OF STUDY 

1. Changes Indicated by Replies to Questionnaire 
It was difficult often to differentiate changes in the course of 
study from changes in methods of instruction. Under this head 
four types of change were more frequently noted than any others, 
(a) Change of Textbooks. In some cases the textbook was 
merely changed for another book. In other eases, the book was ap- 
parently dropped altogether and other types of material substi- 
tuted. 

(6) Emphasis was changed by giving more space in the 
course to different parts of a subject. TMs seemed to be especially 
true in arithmetic and in spelling. 

(c) Numerous replies indicated that the tests served to fix 
standards of achievement for different grades. 

(d) The organization of specialized curricula for special 
classes. 






2. Detailed Examples 

(a) to 5e Achieved. The effect of educational 

on the course of study has been to fix specific aims 

in the subjects, "Witt most of the standard scales 

have been proposed ideal forms for the several 

or the average and median scores made by these grades have 

set as desirable ends to be achieved. 

The specific aims to be accomplished may be grouped under 
three heads: aims in rate of work; aims in quality of work; and a 
combination of the two, under the head of efficiency. 

The accompanying table contains a representative set of such 
aims. The fall meaning of these standard scores will be under- 
stood only in connection with the tests themselves. 

SAMPLES OF SPECIFIC ATMS 



ACTIVITY MBASUBED BT 

Bate of Silent; Beading Gbray (Ancient SMps) 

Quality of Silent Beading fnomdilte Scale for 

Understanding of Sen- 
tences 



Addition 
Addition 
Reasoning 

Spelling 
Writing 



Language 
Composition 
Grammar 
Gteograpny 



Word Knowledge 
Courtis Series B 
Woody Series A 
Stone 

Ayres scale 
Ayree 



Trabue 

Harvard-Newton 
Buckingham 
Hahn-Lackey 



SCOBS 

2.87 words per second 

7.50 on Scale Alpha 2 

8.50 approximately on 
Scale A, A2 or B 

Bate 12 Accuracy 100 
percent 

Accuracy 9.01 scale 
points 

Bate 8.75 Accuracy 90 
percent 

100 to 50 percent on Col- 
umns N to Z 

Bate, 79 letters per sec- 
ond 

Quality, 62 Gettysburg 
scale 

14 to 16 scale points 

70 on scale 

5.13 questions answered 

to 99 percent on 20 sets 
of questions 
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Any pupE wlio at the middle of Ms eighth school year can 
achieve the above standards should be considered normal for the 
grade. A lower attainment clearly indicates the need of remedial 
work for the class or individual in question. A distinctly superior 
achievement is evidence of superior intelligence on the part of the 
pupils or of superior methods of instruction. 

(5) Minimal Essentials. A second important movement mak- 
ing use of measuring methods is the effort to derive minimal essen- 
tials. Of the nine methods of determining the minimal content of 
the course of study described by Coffman, at least four are essen- 
tially methods of measuring the acquired behavior of children and 
adults ; two are measurements of the content of reading matter, and 
the other three are concerned with pooled opinions. Of the ten 
chapters in the Sixfeentli Yearbook of this Society, "Minimal Es- 
sentials in Elementary School Subjects," five make direct use of 
information derived from the measurement of children's attain- 
ments. The other five are based on measurements of the content 
of books and other published material. 

It is unneeessar y to enter here into a detailed statement of these 
investigations. It is sufficient to note that the determination of the 
content of the course of study must follow two fundamental prin- 
ciples suggested by the following questions: (1) What should 
children know and do as children and adults? (2) "What can 
children at any age learn with profit! The final answer to both of 
these questions must be obtained by measurement. 

IV. METHODS OF INSTRUCTION 

1. Returns from Questionnaire 

(a) Increased Emphasis. Approximately one-third of the 
replies note "increased emphasis/ 7 which apparently means more 
time given to a subject or more value placed upon efficiency in it. 
The following are representative of these replies : 

"More emphasis, all grades, on meanings of words and sen- 
tences." "Stressing legibility in writing." "Greater emphasis 
on fundamentals in arithmetic." "More emphasis on correct use 
of words in reading, less on definition." "Special emphasis given 
to those subjects where standard was low." "More drill in all 
grades." "More silent reading." 



(b) Drill. The for Improving attainments 

the to be is "drill 77 TMs term is vague, 

time devoted to repetition of certain 

processes. 

"Arithmetic: All teachers required to give more drill work" 
"Special given to those subjects where standard was low." 

"Five-minute daily drill on fundamentals in arithmetic,'* "More 

and given to drill in number combinations." "Dic- 

tation with attention on punctuation. * * * * More intensive drill 

in and punctuation. ? ' " More drill in spelling. ' ' 

(o) Specialized DriZZ. Some correspondents report a partic- 
ular type of drill, involving a definite change in the details of the 
drill process as weE as change of time 

"Courtis drill cards in arithmetic in two rooms; more oral 
drill in all." "Horace Mann method of spelling adopted." "In- 
stalled Palmer method of writing/' 

(d) New Devices. Another method of improvement of in- 
struction was the invention of special devices. 

"Made room charts showing individual's work (median, quar- 
tile, safety zone) . * ' " Teachers used questions similar to Kelley test, 
and applied to geography and other subjects. 7 ' "More instruction 
through interest of pupil. " "Supervised study periods aU 
grades." **Three periods of supervised study added _to school day : 
those who failed in one subject required to stay 1 period ; in two, 2 ; 
etc. 7 ' " Greater use of dictionary for meaning of words. ' ' " Tests 
devised to watch pupils' progress." 

(e) Individualized Teaching. The measurements serve to Jrx 
attention on individual differences among children and to further 
the adaptation of instruction to individual needs. Illustrations: 

"Individual attention; specifics devised for securing appreci- 
ation of good writing/' " Individual help given slow pupils." 
"Methods adapted to ability of pupils." "Backward pupils dis- 
covered and given special attention," "Promotion more by sub- 
jects." 

2. Detailed Examples 

(a) Methods of Drill in Arithmetic. Mead, at the request of 
Superintendent Condon of the Cincinnati schools, undertook the 
experimental evaluation of two Mnds of practice material in the 
fundamentals of arithmetic. The materials in question were the 
Courtis Standard Practice Tests and the Thompson Minimum Es- 
sentials in the four fundamentals. About 900 fifth-grade pupils 
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from fourteen schools were divided into two approximately equal 
groups and were drilled 15 minutes daily from February to May. 
The efficacy of the two kinds of practice material was determined by 
"preliminary and final standard tests with each, group 5 ' (Courtis 
Series B). The initial and final tests, as well as the intervening prac- 
tical exercises were given by the class teachers under standardized 
instmetionSj and care was taken to keep conditions constant and fa- 
vorable. 

The results of this carefully controlled experiment show that 
in speed of work the two Mnds of practice material produce im- 
provement, and essentially the same amount of improvement. Both 
also show gains in accuracy of work, but they differ essentially in 
the amount of improvement in accuracy resulting from the exer- 
cises. The pupils of the twelve classes using the Thompson Mint- 
mum Essentials show median gains in percent of accuracy for the 
four fundamentals of 2.5, 4.0, 2.9 3 and 15.7 ; similar figures for the 
Courtis Practice Tests were 9.7, 8.1, 8.9, and 18.2. Clearly, the 
Courtis Practice Tests are superior, and the test shows in what re- 
spect they are superior. 

It does not follow from this that the Thompson Minim-rim Es- 
sentials are of no value or that in another grade and under other 
conditions they might not prove superior. What is fairly certain 
is that, upon the use of the two methods in fifth-grade classes under 
school conditions prevailing in Cincinnati schools from February to 
May, 1916, and described by Mead, the debate has closed. 

(6) Teaching of Handwriting. The " two-squad " method 
has been used by Mr. A. K Gapps in measuring the effect of "diag- 
nosis and corrective measures in the teaching of handwriting/* 
The handwriting of 44 sixth-grade children was measured on Octo- 
ber 9. All who scored high on the Thorndike scale, Quality 9 or 
more, and whose papers were relatively free from common errors, 
were put into an "advanced class." All others were put into a 
"special class." The advanced class was taught three days per 
week; the special class, five days per week A pupil was allowed to 
pass from tie "special" to the "advanced" class, when on the 
monthly tests he scored Quality 10 (Thorndike). 
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All were by the method, which was 

as : The of each pupil was diagnosed follow- 

ing of " quality 7? into alignment, spacing, 

of Hue, and letter form. On the basis of this diag- 
was prescribed for each class and for each 
detailed methods of instruction were worked out. 
made acquainted with their own difficulties and 
to practice with a view to achieving certain detailed aims, 

as better form for the letter a, improved alignment, etc. The 
experiment was continued for five months, and standard tests were 
given at four-week intervals. 

The significant results of the experiment may be stated as fol- 
lows: (1) The advanced class improved in quality from 9.06, or 
less than fifth-grade attainment, to 10.47, or slightly more than 
seventh-grade scores (60 minutes per week) . (2) The special class 
improved from 8.74, or fourth-grade score, to 9.68, or slightly less 
than sixth-grade average (100 minutes per week). In both classes 
there was a substantial gain in speed, 

In the light of these results, regarded as tentative by the ex- 
perimenter, there can be little doubt this teaching method has! con- 
siderable claim to efficiency. 

(c) Improvement in Written Composition. Somewhat differ- 
ent in type is the study by Brown and Haggerty of the improve- 
ments in English composition. The weekly composition exercises of 
three Mgh-sehool classes through a period of twelve weeks were 
measured by the Harvard-Newton Scale. By this method it was pos- 
sible to secure a "learning curve" for individuals as well as classes, 
and thus to see the educational behavior of a student somewhat 
more intimately than when only initial and final measurements are 
made. 

From this experiment several facts stand out. (1) There is 
no essential difference in composition performance among classes 
rated as first-semester freshmen, second-semester freshmen, and 
first-semester sophomores. (2) In general, classes gain in power 
to write during a twelve-weeks period about four or five Harvard- 
Newton Scale points. (3) Some students, relatively poor ones, 
gain much more than the class average, in some cases as much as 
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twenty scale points. (4) Otter students, often the superior indi- 
viduals, make little or no improvement; some individuals do more 
poorly at the end of the twelve-weeks period that at the beginning. 
(5) Some composition topics elicit better products than others, as 
shown by the median scores of all classes. 

This simple experiment does not get very far in solving the man- 
ifold perplexing problems of composition teaching. The method, 
however, offers a means of further investigation. 

V. TIME DiSTBmunoN 

The changes in time were mostly of the nature of increased 
time to subjects where the tests showed the product to be low grade. 
The following are characteristic replies : 

"Lengthened periods for subjects where deficiency was greats 
est. * ' * * More time given to arithmetic. y * " More time given to writ- 
ing in all grades. *' "Ten minutes of arithmetic recitation period 
used for drill three days per week. ?> "Increased number of hours 
for industrial work." 

Only one correspondent reported a diminution of time, say- 
ing, "We excused pupils and grades from work 'over doneV 
Numerous studies, from that of Dr. Rice on, have shown that results 
of school work are not directly correlated with the time spent on the 
subject. Studies in handwriting, spelling and arithmetic show that 
the maximal time may yield poorer returns than a smaller amount 
of time. 2 

VI. CHANGES IN SUPEBVISION 

As a rule, tests have been introduced into the schools through 
the supervisory and administrative officers. It is not surprising, 
therefore, to find that the results of the tests have had a direct and 
considerable effect on the detailed Work of such persons. 

The general supervisory practice is to report the results of tests 
to principals and teachers. Such a report gives not only the scores 
of the class or classes concerned but also comparable norms from 
other classes within the system and from other systems. Appar- 
ently some supervisors end their use of the tests with this report. 



concrete studies in this field were reviewed "by the writer in School 
<md Society, November 19, 1916. 
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A by supervisors is a conference be- 

the and a conference in which "the opin- 

ion of the is not pitted that of the teacher, but 

in the of both Is directed to the definite and object- 

ie of the test to the producing such result." 

out of conferences come "new outlines of wort" 

"re-organization of programs/' "special lessons for teachers in 

" " requirements in the handwriting of teachers, 
in fact, any one of the changes hitherto enumerated. 

A third step to be noted is a further examination of a class or 
pupil for the extension of the diagnosis. This is made with other 
through personal investigation. 

A fourth step taken by some supervisors and teachers is a 
second measurement, after a period of remedial work, to test the 
efficacy of the changed program. In about one-fifth of the cases 
where remedial work was reported, the supervisor had used the 
tests in this way. The following are typical replies : 

In arithmetic "Graph showed greater improvement in grade in 
one month, than first graph showed from class to class (five months 7 
work)." "Have used drill and are now above the Courtis Stand- 
ard.' 7 "The weaker pupils do better work. More pupils brought 
up to required standard. Pupils more accurate." "Plateau dis- 
appeared which had existed from Grade VI to VIII ; curve for both 
attempts and rights in all operations shows gradual development 
to Grade Vin." 

In reading: "Improvement in median score from September 7 
to January 23 ; Grade VII, 5.3, Grade VIII, 5.6." 

In spelling: "Pupils average a grade higher." "More un- 
iformity of grades and children know where they stand. " 

In writing: "Better quality. Both quality and speed nearer 
average for grade." 

A fifth important use of tests by supervisors is to keep track 
of the normal progress of students and classes. Eesults of such tests 
serve as a sort of weather map of the school system and show the pre- 
vailing winds. They enable the supervisor to know in an intimate 
way the entire system and to direct his efforts at supervision where 
they are most needed. Where fair progress is being made he can 
give little attention and save Ms usually inadequate energy for the 
places where it is most needed. 
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Finally, It is apparent that supervisors are making- the 
attainment, as shown by the results of measurement, one f actor in 

the rating of teachers and for the farther professional training of 
teachers. The following replies show this : 

* * Introduced a system of teacher training. ? ? " Certain teachers 
required to go to summer-school.^ "Teachers required to visit 
classes with strong teachers." "In second semester, clianged 
teacher whose class was weak to a lower grade class, to test power 
and presentation of subject." "Certain changes in both principals 
and teachers, and wiE require certain teachers to attend summer- 
gehooL" 

The experience of one supervisor is related in a most interest- 
ing paper on the Supervisor's Use of Standard Tests, by 3. C. Morri- 
son, who presents the details of a year's work in Chatham, Mass., 
and sums up the work in these words : 

"Standard tests have proved an effective means in super- 
vision. Through their use teachers are improving the technique of 
their method and exercising a nicer judgment in the relation of sub- 
ject matter. Pupils are working to exceed their own record. Teach- 
ers and older pupils are coming to understand the scientific idea of 
education as it applies to the ordinary classroom. In no other way 
could the principal gain so close a knowledge of each individual 
child in the school. This knowledge is serviceable in placing new 
pupils, in determining promotions, in selecting accelerates and de- 
fectives, in searching out the special difficulties of the individual, 
and in gaining the cooperation of the parent. The results of the 
tests have proved of interest to the public. On the basis of these 
results the board of education has employed a teacher to give ap- 
proximately one third of her time to the testing and supervision of 
work with special pupils. The school has made a start in the study 
of its children and will eliminate a large part of the wasted time 
and effort that results from the choice of the wrong high-school 
course.** 

In this survey of remedial measures based on the use of stan- 
dard tests one observes that many of the changes made are the time- 
honored ones which school officers have traditionally made on the 
basis of personal opinion and in response to changing ideas. Ap- 
parently what the tests do in such cases, is to render definite the 
arguments for these changes and to make accurate the evaluation 
of the efficiency of remedial measures when once they have been car- 
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To a who to Ms practice by facts 

by sufficiently Justifies the idea 

of To the case "with other types of individuals 

is 3 a of time. 

One the show, however, which traditional practice 

never recognized, because it never knew it ? and that is, the 

of individual differences among children, both in 

ability in attainment. These differences the tests reveal in a 

way inevitably alter profoundly our whole program of 

education. 



CHAPTER IV 

GENERAL ORGANIZATION OF EDUCATIONAL* MEASURE- 
MENT WORK IN CITY SCHOOL SYSTEMS 



W. BALLOT 

Director, department Edueational Investigation and Measurement, 
Boston, Massachusetts 



Every change which takes place in educational practice is pre- 
ceded by a period of agitation. The profession must "be made aware 
that a given condition is unsatisfactory and must be convinced that 
the proposed change will bring about improvement. In addition, 
the lay public must be educated to understand the meaning and 
significance of the proposed change. Many educational schemes 
never proceed beyond this stage of professional and public agita- 
tion. 

Following the period of agitation comes a period of trial and 
experimentation, in which the proposed change is subjected to dose 
scrutiny. Generally, both the profession and the public produce 
searching and frequently unjust critics. These criticisms usually 
prevent even a trial of any changes in our educational practice 
which do not give promise of a reasonable degree of success, 

In those cities where special research departments have been 
organized, educational measurement is established beyond the stage 
of argument or debate. There the movement has passed success- 
fully through the periods of agitation and of experimentation. Even 
through the country generally, the movement has received such gen- 
eral recognition and endorsement during the past few years that 
progressive school systems do not now need to be provided with 
arguments in favor of educational measurement. This chapter, 
therefore, is not an argument for the introduction of educational 
measurement: it is not a discussion of the debatable phases of the 
subject; neither is 5 it a delineation of the educational advantages to 
be secured by measurement. Bather, it is a description of ways 
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and of educational measurement in 

a city and it on successfully. The methods 

are which appear to have succeeded best in those 

city have undertaken to measure educational 

in an way. 

The for the introduction of educational measurement into 
a should be wisely chosen ; standard tests should be 

given only after the way for them has been carefully prepared. The 
of any educational reform depends on the intelligent co- 
operation of the members of the educational profession. This is 
especially true of educational measurement, because it involves an 
entirely new method of attacking educational problems and an al- 
tered attitude on the part of teachers toward the whole educative 
process. Success is contingent on a thorough understanding of the 
aims ? methods, possibilities, limitations, and achieved results of 
the use of standard tests and scales. Unless and until the profes- 
sion is go informed, and as a result is prepared to cooperate effect- 
ively in its administration, the possible values of educational meas- 
urement are not likely to be secured. Proper instruction through 
lectures, talks, and teachers' meetings will do much toward pre- 
paring the way for success in carrying on such work. 

Educational measurement involves selection of the tests to be 
used, testing the children, marking or scoring the papers, tabulat- 
ing and interpreting the results, and utilizing the conclusions as 
a basis for securing improvements in teaching when the outcome 
proves that the present teaching is unsatisfactory. This chapter 
deals with each of these topics. 

A. SELECTING THE TESTS 

The attitude of teachers and others towards educational meas- 
urement depends largely on first impressions. The importance of 
making favorable first impressions, therefore, cannot be over-em- 
phasized. The first standard test selected to be given In a school 
system should be one which is most likely to be favorably received 
by teachers. Fairly satisfactory tests for several subjects or phases 
of subjects are now to be had. 2 



a See Chapter VII for a list of available standard tests and scales. 
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Adequate for anj school system should 

the following characteristics: they should measure educational pro- 
ducts obviously within the scope of the course of study of the city ; 
they should aim to measure subjects or phases of subjects 

which are clearly measurable; they should be reasonably simple; 
they should be accompanied by adequate instructions as to how they 
are to be given and how the results are to be scored ; they should be 
scored and tabulated with reasonable ease; they should already have 
been given to a sufficient number of children so that well-founded 
standards of achievement have been established. 

The demand for standard tests in various subjects has been so 
great that some questionable tests have been put on the market 
For example: a so-called 'standard test in spelling' is available 
which tests the ability of children in Grades V to VIII to spell such 
words as the following: nunciature , sphericity, toggery, senescent, 
symmetrize, incremental, rigmarole, verisimilitude, antJiropometric, 
tubule, erosible, and divestiture. These words are not to be found in 
the course of study in most school systems in the United States. 
Lack of ability to spell such words cannot be charged against the 
schools, because the schools have not undertaken to teach children 
to spell them. This test and others like it that do not measure 
classroom instruction, should be* avoided at least in the beginning 
of testing work. If they are used, the purpose in giving them and 
their limitations should be distinctly understood. There are satis- 
factory standard tests in spelling which are obviously within the 
scope of classroom instruction. 

Criticism has been urged against educational measurement on 
the general ground that important products of good teaching in cer- 
tain phases of all subjects and in all phases of certain subjects can- 
not be quantitatively measured. "Whether this is so or not may be 
debatable: let the debate go on. It is not necessary, however, to 
postpone all educational measurement until the debate is settled. 
In the meantime, giving standard tests in measurable subjects or in 
measurable phases of subjects will be profitable for teachers and 
pupils, and may also furnish valuable information by which to 
determine to what extent the results of educational practice gen- 
erally are measurable. 
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In into a school system 

for the the the are ? the better. To be usa- 

ble, be accompanied by adequate instructions 

for and for marking the papers. Unfortunately there is 

no to travel in carrying on educational measurement. 

The of giving the tests must be mastered by those who would 

proper use of them. If tests are worth giving at all, they 
be given according to the systematic plan wMei. the author 
of the tests has worked out. Success in introducing testing into a 
school system will be more certain if the tests are selected only after 
careful consideration of the instructions for giving and scoring 
them. 

It is also important that well-reeognized tests be used in the 
initial testing in a school system. Not everyone who desires to give 
standard tests has the time, resources, or qualifications for prepar- 
ing Ms own tests. It cannot be too urgently recommended that at 
first tests should be selected from those already available. Later,. 
one may saccessfolly experiment with, the preparation of the tots. 
Among the gravest dangers which educational measurement faces 
today is that which arises from amateurish, attempts at the con- 
struction of standard tests by those who do not realize the need for 
a careful testing of the tests themselves before they are published 
for general use. 

Well-recognized tests are urged for use; first, because such 
tests are undoubtedly superior to those which would be prepared 
under most circumstances by a beginner ; second, and more partic- 
ularly, because the results achieved in any school system can thereby 
be compared with similar results from other school systems. 

One of the desirable outcomes of the giving of standard tests 
is the establishment of standards of achievement. Such standards 
furnish measures with, which one may compare Ms own results. 
Standards are adequate, however, only when they are based on a 
large number of results. Tests wMch have been standardized from 
the results acMeved by a small group of pupils in one or two school 
systems are to be avoided unless there are other quite special reasons 
for using them. 
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Testing should always be purposeful. Testing children merely 
for the of giving tests cannot be too thoroughly condemned. 

The following principle of practice is commended: never give a 
standard test unless you have a definite purpose related to the im- 
provement of instruction and unless yon are prepared to tabulate, 
interpret, and use the results at once. 

Since the ultimate purpose of aU educational measurement is 
the improvement of the instruction, it also becomes of paramount 
importance that the results be made known to the teachers and 
others before their interest in the tests has waned. 

B. GETTING TESTS GIVEN 

Let us repeat that if the results obtained from giving standard 
tests are to be worth the time, money, and effort expended, the tests 
must be properly given. This means not only that they must be given 
in the same manner in every classroom throughout a school system, 
but it means, also, that they must be given according to the direc- 
tions that accompany the tests. If this is not done, the results 
cannot be compared with the standardized achievements in other 
cities a fact which renders the interpretation of the results very 
difficult, if not impossible. 

It may be assumed that the author of the tests had reasons 
for adopting the procedure indicated by his instructions, and that 
the most effective use cannot be made of the results obtained in any 
school system unless those directions are followed. Even though 
one does not agree with the directions for conducting the tests, 
one would better not use the tests at all than to deviate in any im- 
portant respect from the author's directions for giving them. 

Tests may be given dither by principals, supervisors, or teach- 
ers, or by persons especially trained for the purpose. Such tests 
as spelling tests, which are among the simplest to give, may be 
given satisfactorily by principals or teachers. They do not require 
careful timing, and the directions for giving are comparatively sim- 
ple and are easily followed. With a minimum of instruction any 
principal or teacher can successfully conduct spelling tests. 

Such, tests as the Courtis standard tests in arithmetic offer a 
more difficult problem. They must be accurately timed and the 
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are given must be controlled. Those 
who give be trained for the purpose. ^ 

For this one of two methods may be followed : a group 

of or principals in the service may be instructed, outside 

of and assigned to give these tests in the various 

throughout a city. Or, as in Boston and other cities, those 
preparing to become teachers may be trained to give these tests 
as a part of their preparation for teaching. In Boston each mem- 
ber of the senior elass in the Normal School spends one month in 
the Department of Educational Investigation and Measurement and 
receives instruction in the meaning of educational measurement 
and the training necessary for giving such tests as the department 
desires to have given. Following this training, these seniors are as- 
signed to give the tests in the various schools of the city. 2 Very 
similar arrangements are made in many other places. Cities in 
which a college or university is located have also used trained col- 
lege students of education as special examiners. 

Experience has not yet determined which practice is likely to 
be followed in the future. It is certain that whoever gives tests 
must receive proper instruction in the methods of giving them. The 
policy of training normal-school seniors in measurement work is 
based on the assumption that the teaching staff of a city onght to 
be competent to give such tests as are needed for the measurement 
of the work of a school system. If the teachers of a city can be so 
trained, this is undoubtedly the cheapest and most effective method 
of solving the problem. If, for one reason or another, teachers do 
not prove satisfactory as examiners, then it necessarily follows that 
competent specialists must be employed for giving the tests, as well 
as for carrying on other phases of educational measurement. What- 
ever be the method finally adopted, those who give tests must not 
only be properly instructed, but their work must also be adequately 
supervised. This supervision is the function of a department of 
educational research. In the absence of such a department in a 
school system, the superintendent's office should assume this re- 
sponsibility. 

One of the difficulties in relying on the teaching staff as a 
whole to give standard tests grows out of the attitude of teachers 
2 See article by the writer in School and Society, Vol. Y. pp. 61-70. 
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toward such .tests. In their attitude toward educational measure- 
ment one may expect to find three distinct of teachers in 
every school system: (1) who endorse it, (2) those who are 
indifferent to it, (3) those who oppose it. On this account it is prob- 
ably wise to introduce standard tests into a school system on a vol- 
untary basis ; that is, to give the tests only in those schools or classes 
where principals and teachers are willing to have them given. 

The success of educational measurement in a school system 
depends on doing a small amount of testing and doing it well, rather 
than on doing a large amount. Quality rather than quantity is more 
likely to win favor. Opposition to educational measurement can 
best be disarmed by showing the improvement secured from the re- 
sults of standard tests. 

C. SCORING THE PAPERS 

The amount of time involved in giving tests is small compared 
with tie time necessary for correcting the papers. Assuming that 
the teachers give the tests, who shall mark them? The answer to 
this question depends largely on the character of the tests. Cer- 
tain types of papers from some tests can be satisfactorily marked 
by the pupils under the supervision of the teacher. For example: 
if a spelling test is given by the teacher, she may at once spell the 
words aloud and have the children mark the errors, following the 
common practice. The pupils' scoring in every case, however, 
should be properly cheeked by the teacher. Likewise, in some tests 
in arithmetic, children may be provided with answer cards and 
shown how to correct the papers. 

The scoring of many tests, however, involves the exercise of 
some judgment, and pupils cannot be depended on to score such 
tests. In most cases, papers in geography and history should not be 
scored by pupils. Further, if one desires to give credit for a correct 
method in problem work in arithmetic, even though the answer is 
incorrect, the judgment of the teacher is undoubtedly necessary. 

Teachers should not be burdened with ant unreasonable amount 
of work in the giving of standard tests. A satisfactory prin- 
ciple to follow may be stated as follows: teachers should be expected 
to correct test papers and tabulate results only in so far as this work 
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the teacher's of the abilities of pupils in her 

Patting principle into practice would mean that in most 

the may be expected to mark the individual papers 

of in her She mayjbe expected, also, to mate class 

or summaries of individual achievements, because only 

by so doing can the teacher learn where her class stands in relation 

to other in the school, or in relation to the general standard 

of achievement established for the test. Beyond class summaries 

the work is likely to be too largely clerical to be of direct value to 

the teacher^ and should be carried on by others. 

In marking papers and making class tabulations, teachers 
should have some one to whom to look for instruction and guidance. 
If there is no regularly organized department to supervise and di- 
rect educational measurement, some qualified person in the system 
should be assigned to do it. Through teachers' meetings held after 
school, for which classes may be dismissed a half hour or an hour 
early and through instructions issued from time to time, the 
snpervisor of educational measurement can materially lighten the 
burden which otherwise falls on teachers in this type of work. 

D, TABULATION AND INTERPBETING THE RESULTS 

In Boston the Department of Educational Measurement has 
found an effective and economical way of making grade summaries, 
school summaries, and city-wide summaries of testing results. Girls 
from the Boston Clerical School are assigned to this work. These 
girls are being trained specifically for clerical work and on gradua- 
tion from school may take positions which require skill in just the 
kind of work involved in making tabulations from tests. The Depart- 
ment asks the Clerical School to send relays of eight or ten girls as 
long as the work lasts. Each group of girls reports for three or four 
days to the office of the Department where the tabulating is to be 
done. The Department instructs them in the special methods of tab- 
ulation, and has the work so systematized that a definite record is 
kept of the speed, accuracy and effectiveness of the work of each 
girl. Their attendance is also kept and reports are made to the head 
master of the school when the girls return. The teachers in the Cler- 
ical School consider this work an important part of the practice and 
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training which the school to give. The Department has found 

it a satisfactory method of getting the work done. The expense to the 
city involves only the ear-fare of the students to and from, their 
homes to the office of the Department. Much the same method has 
been followed in other cities that have commercial departments in 
their high schools. It affords a practical solution of what is often 
a critical problem in measurement work. 

If teachers or prospective teachers are trained to give the tests, 
and to score the papers of their respective classes, and if commercial- 
Mgh-sehool pupils or normal-school pupils are used to make grade 
summaries, school summaries, and city-wide summaries, little or 
no direct expense is involved in that part of the work. But even 
though members of the teaching staff or pupils in the school system 
are thus employed, many additional tabulations will be desirable 
and necessary if the results are to serve their greatest usefulness. 
For such work it is essential that competent clerical help be pro- 
vided. It is the Mnd of work which is not easily done by those un- 
familiar with it, and is likely to be tedious as well as voluminous. 
To be done effectively it should be done by those who understand it 
and who have more than ordinary interest in it. Such persons can 
be found in every school system and when found, should be assigned 
to render this Mnd of service. No city should undertake educa- 
tional measurement without understanding that it involves some 
expenditure : a portion of this should be devoted to the securing of 
competent clerical assistance for statistical tabulations and another 
portion to the general direction and supervision of the work (by 
the superintendent of schools in the smaller cities and by a special 
school official in the larger cities) . 

After the various tabulations and summaries have been made 
by grades, by schools, and for the city as a whole, the results must 
be interpreted. This is one of the most important phases of educa- 
tional measurement. On the interpretation of the results really 
depends the usefulness of the tests. One of the greatest dangers 
involved in educational measurement throughout the country today 
is the fact that many persons are giving tests who are not com- 
petent to tabulate and interpret the results. In general, interpreta- 
tion should be made by the superintendent, or by some other school 
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conversant with all the local conditions. The 

will be obtained when some competent person, who is 

in and trained for such work, is engaged by the 

board of education to supervise the giving of tests and to interpret 

the to the teaching staff. 

E. MAKING USE OF THE RESULTS 

Successful educational measurement work in a school system 
Involves not only selecting the best available tests, giving them ac- 
cording to directions, scoring the papers, tabulating the results, 
(all at a minimum of cost in time, energy, and money) and inter- 
preting the results, but it also involves getting the information de- 
rived from the tests to the persons concerned, getting those persons 
to consider it, and getting them to do something about the condi- 
tions revealed, if those conditions demand it. 

Obviously, some sort of report must be prepared by the official 
who interprets the results of the tests. Typewritten or mimeo- 
graphed copies of the report may be made for a small school system, 
bnt if a large number of copies is needed, the report should be 
printed. If printed, it is more likely to be given consideration by 
those concerned and to be kept for future reference and guidance. 

Much of the success in getting the desired information to 
those concerned will depend on the character of the report. With 
conditions as they are at present, the facts must as far as possible 
be stated in simple, non-technical language. Few teachers now in 
the service have any knowledge of the technical terms employed 
in. educational statistics. If such terms are used, they must be care- 
fully defined. Our courses for the training of teachers are now be- 
ginning to include some study of educational measurement. It will 
be a generation, however, before the teaching profession as a whole 
can be presumed to have had training in educational statistics. Until 
that time it will be necessary to prepare non-technical reports for 
the teaching profession. 

Finally, it should be emphasized that standard tests are for di- 
agnostic purposes: they show the abilities and needs of children. 
Recently one teacher said : "My class has taken the Courtis tests in 
arithmetic twice each year for three years, and I do not see that it 
has done them any good ! ' y On investigation, it was found that this 
teacher had made no effort whatsoever to use the information furn- 



EDUCATIONAL IN CITY 51 

ished by the as a basis for correcting the many 

shown among her pupils. There is no special magic in standard 
tests which will work any educational miracles on pupils who take 
them. The teacher must be made to realize that the results from 
the tests are for her inf ormation. Unless she is shown how to make 
use of them, and is willing to do so, standard testing is not worth 
wTiUe. On the other hand, if the teacher is willing and intelligent, 
the information derived from standard tests is of the greatest ser- 
vice. For it enables her to reach desired goals by the most direct 
path, with the least expenditure of energy and labor on her part 
and with the greatest benefit to the children. 



CHAPTER V 
BUREAUS OF RESEARCH IN CITY SCHOOL SYSTEMS 



EUGENE A. 
Director, Bureau of Research, and Bef erenee, Kew York City 



The city bureau of educational research is the direct and logi- 
cal outcome of the combination of the surrey movement and the 
movement for the use of measurement. A careful appraisal by a 
group of experts from without has been demanded and paid for by 
community after community. Very evidently such stock-taking Is 
regarded by the public as beneficial in Its effects. Too often, how- 
ever, the result, as far as the local schoolmen are concerned, has been 
disastrous. The time spent by the experts in the local field is nec- 
essarily short, their knowledge of local conditions necessarily lim- 
ited and their 4 interpretation of results has sometimes seemed to lo- 
cal school officials unwarranted and unjust. More often than not, 
superintendents have attempted to explain away the defects re- 
vealed and to make light both of the facts and of the recommenda- 
tions of the survey experts. But facts are stubborn things, and 
changes of superintendents and upheavals and reorganizations of 
various sorts have inevitably followed the adoption of such a policy. 
So It has come about that many times a survey report has been of 
more direct benefit to schoolmen in other cities than to those in the 
city for which It was made. 

Thoughtful superintendents have come to see that, above every- 
thing else, the best insurance against the survey lightning is a sur- 
vey conducted from within. Many a schoolman has asked himself 
the searching questions: "What would a survey reveal about my 
school system f On a factual basis, what do I really know about my 
own work? 7 ' Straightway he has- begun himself to Investigate. The 
various types of studies made in a modern survey are repeated on a 
smaller scale. Measurements are made and constructive attempts at 
remedial adjustments are begun. 

52 
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The average administrator, however, Is a busy man. He has 
little time, and by virtue of Ms training and position, little aptitude 
for close analytical studies or statistical investigation. Ordinarily 
lie himself does just enough to realize the importance and value 
of the work, then delegates it to a specially trained person who 
works under Ms direction. In the sm^ler towns and cities this per- 
son may be only a clerk or "bookkeeper who performs the mathemat- 
ical and statistical labors involved. In the medium-sized cities a 
supervisor or assistant superintendent is often detailed to give part 
or all of Ms time to the work, and in the larger cities there are for- 
mal organizations of special research departments. 

One of the best I ormulations of the functions of such research 
work is to be found in the report of the Committee on School In- 
quiry, New York City. Professor E. C. Elliott in Ms study of the 
administration of the New York Schools 1 made among others the 
following recommendation : 

"Recommendation III 

"That there be established as an integral part of the system of 
school control, a Bureau or Division of Investigation and Appraisal. 

**TMs bureau or division should be in charge of a cMef or 
superintendent, who is directly responsible to the Board of Edu- 
cation, and should be organized in such a manner as to enable it 
to serve as the central agency for the gathering and interpretation 
of statistical and other data with reference to the schools ; and also 
for the carrying on of such investigations as are necessary for the 
rational development and expansion of the school system. It should 
bear the same general relation to the Department of Education as 
the existing Bureau of Municipal Investigation and Statistics bears 
to the Department of Finance. 

"The following arguments may be indicated: 

" (1) The school system, of the city suffers from a lack of defi- 
nite, detailed knowledge of its own working and its own cost. As 
has already been pointed out, the fundamental importance of the 
inspectorial form of control has been recognized only to a very lim- 
ited extent. And even where its importance is recognized, officials 
charged with the responsibility for administrative or supervisory 
duty appraise their own performances. Investigation that is needed 
is not carried on at aJL 



*%eport on Educational Aspects of Public School System of the City of 
New York to the Committee on School Ingwry of the Board of Estimate and 
Apportionment, Volume H, page 401. 
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" (2) It is evident that one of two things will result in the 
future. Either the work indicated for this proposed 
bureau will be attempted by agencies outside of the school system 
or there be established; within the school system, as an 

integral part of its organized control, an agency properly equipped 
investigators to set forth to the supervisory and ad- 
ministrative officials of the school system, and the people of the 
city, facts absolutely necessary for the intelligent 

development of schools and of public sentiment Of these alterna- 
tives, it would seem that thq latter is to be greatly preferred. No 
outside agency could carry forward the work of inspection and of 
formulating impartial Judgments of results, and of proposing new 
procedures without much friction and loss of energy. 

" (3) The problems of public education in New York City are 
not conventional problems. Many of the more pressing ones are 
new in the social and educational world. They cannot be solved by 
preconceptions, or the showing of hands. In so far as possible, 
the situation and causes that have generated these problems must 
be weighed and analyzed before rational and permanent solutions 
can be found." 

This recommendation was immediately acted upon. A Division 
of Reference and Eesearch was formally organized and began its 
work at the opening of schools, September, 1913. The quotation 
above, therefore, is of historical interest. For while the New York 
Bureau by no means represents the beginning of systematic, scien- 
tific study of school problems by school authorities, it was undoubt- 
edly the first to be definitely organized for that sole purpose. 

The real beginning of the movement that has led to the es- 
tablishment of bureaus of research cannot be clearly traced. In 
some cities there have been for many years committees, bureaus and 
special commissions for the more or less systematic study of build- 
ings, of children, of teachers, of instruction, and of many other 
forms of school activities. As rapidly as the movement for meas- 
urement has developed, the investigations of these agencies have be- 
come more and more truly scientific. Even today the organization 
and function of a bureau of research are not clearly defined, and all 
sorts of studies are being carried on by all types of workers. In some 
cities, the department consists of little more than a high-sounding 
title bestowed as a compliment upon some existing school officer. In 
others, the director of the bureau is given the rank and salary of an 
assistant superintendent and is a real director of an extensive de- 
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partment. Between these two extremes every type of variation may 
be found. 

It is not surprising, there! ore, that the actual work of a bureau 
of research varies from city to city, being determined in the main by 
the tastes and training of the director, and somewhat by local needs. 
In some cities attention has been given almost wholly to a study of 
costs and to purely administrative problems ; in other cities the en- 
ergy of the department has been expended only on the measurement 
of educational products; in still others the deliberate attempt has 
been made to do some work in every field. In general, the tendency 
seems to be to regard the special function of the department as the 
devising, giving, scoring, tabulating and interpreting of standard 
tests and the prosecution of such other investigations only as may 
aid in the interpretation of the results secured. 

A city department of research ordinarily consists of a director 
and clerical or stenographic assistants. At first, the tendency was 
to select any capable schoolman available, with little regard for Ms 
qualifications for the special work, but later appointees, either as 
directors or assistants, have been young men or women specially 
trained in statistical methods and in educational measurements. The 
director, almost without exception, is responsible directly to the 
superintendent and under Ms immediate control. The salaries paid 
range from $1,100 to $6,000, (median of 13 cases $2,700). 

It has proved very difficult to obtain complete information with 
regard to the number of cities wMch have organized bureaus or 
wMch are carrying on organized work in measurement. 2 In spite 
of repeated questionnaires and persistent efforts, only a most tenta- 
tive list can be given. However, formal organizations are found in 
the cities listed on the following page. 

No attempt has been made to list cities in wMch research work 
is being carried on without formal organization, because of the im- 
possibility, both of making the list at all complete and of distinguish- 
ing between a mere incidental use of tests once from idle curiosity 
and their persistent, intelligent use, year after year, for worthy 
ends. Seattle, for instance, does all the work and has all the benefit of 
a bureau of research, but has no formal organization. The assistant 

2 The various functions of a bureau of research are illustrated in other 
chapters, and the discussions win not be repeated here. 
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LIST OF CITY BUREAUS OP RESEARCH 



City 


Title of Bureau 


When "Nam. of 
Organ- Director 
ized 


1. Baltimore, Mi. 


Bureau of Statistics and 






Beseaich 


Edwin Hebden 


2. Bcwtom, 


Department of Education- 






al Investigation and 






Measurement 


1914 Frank W Ballon 


3. Buffalo, 3SL T. 


Bureau of Research 


1916 Wm. A. Mackey 


4. Chicago, HI. 


Department of Standards 






and Statistics 


1917 S. B. Allison 


5. Cleveland^ OMo 


Department of Reference 






and Research 


1916 C. W. Button 


6, Detroit, Michigan 


Department of Educa- 






tional Research 


1914 S. A. Courtis 


7. Bibbing, Minn. 


Department of Educa- 






tional Research 


1915 J. W. Richardson 


8. Kansas City, Mo. 


Bureau of Beseardi and 






Efficiency 


1914 Geo. Meleher 


9. Louisville, Ky. 


Psychological Laboratory 


1914 Henrietta Y. Race 


10. Los Angeles, CaL 


Division of Research 


1917 Robert Lane 


11. Few York City 


Bureau of Research and 






Reference 


1913 E. A. Mfeneeker 


12. 3Tew Orleans, La. 


Bureau of Educational 






Research. 


1912 (Discontinued) 


13. Oakland, CaL 


Bureau of Reference and 






Research. 


1914 Virgil E. Dickson 


14. Ornate, Neb. 


Bureau Educational 






Research 


1917 H. W. Anderson 


15. Bodbester, N. Y. 


Efficiency Bureau 


1912 J. P. O'Hern 


16. St. Pan], MI'TITI. 


Bureau Research and 






Efficiency 


1917 L. L. Everly 


17. Sekneetady, 3SL Y. 




1913 EL Lr. Davenport 


18. Topeka, Ks. 


Bureau Research and 






Efficiency 


1916 Ira J. Bright 



snperintendent in eliarge is a director of educational research, in all 
but name. There are a large number 1 of such, cities throughout the 
United States. At the other extreme is the superintendent or 
teacher whose curiosity is stimulated by some talk or article, and 
who gives a test once to a single class. The sales of standard tests 
have grown to very great proportions. Last year, of a single popu- 
lar test ? nearly 900,000 were used, and the annual sale of a few other 
tests run well over 100,000 copies each. Nor is the use of tests con- 
fined to this country. Shipments are made to all quarters of the 
world. It seems quite probable, therefore, that the number of bu- 
reaus of research are destined to be greatly increased in the im- 
mediate future. 



CHAPTER VI 
COOPEBATIYB WORK A UNIVERSITY CENTER 



J. ASHBAUGH 
Director Educational Service, Exteiiffloii Divisioziy State Umversity of Iowa. 



One of the most significant developments in the university in 
the last twenty years lias been the growth, of the idea of service 
service not only to the comparatively few who were able 
to come to the campus, but service to the many who were not able 
to come. The idea was developed largely in state universities, where 
the funds for support came from direct taxation of all the people of 
the state and where the leaders came to realize that the service of 
the university should be extended to all who were taxed to support 
it. Only recently, however, has the university as a whole made an 
organized effort to educate all the people in its territory and to ren- 
der service in the solution of the problems of its supporters off the 
campus. In fact, some of our state universities are doing almost 
nothing in these linos at the present time. 

One of the very latest lines of service to be developed is that 
of cooperative educational research. The movement is so com- 
pletely in its infancy that the method and the organisation of the 
work have" been but imperfectly worked out. However, two aims 
are rather definitely agreed upon by those engaged in this work, 
namely: (1) to make the university bureau a center for the direc- 
tion of cooperative work with the school people of the state in the 
solution of the problems in which the latter are most interested; 
(2) to make the bureau an agency for the collection of rough data; 
for the tabulation, organization, and interpretation of these data; 
and for the distribution of the results of the study to the people 
contributing and to others, in order that significant facts may be 
known by the workers in the field. 

A third aim might be added (though it must necessarily be sub- 
servient to the other two) that of gathering masses of scientific 

57 
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be in the further study of educational prob- 
lems. 

Nearly all connected with public-school work will lend 

to cooperative research when once the university and the 

in the state come to a close understanding. The early 

in the collection of data on school attendance, age-grade and 

age-progress studies^ school health and causes of absence, the use of 

standard in arithmetic, reading, spelling, etc. ; the figuring of 

unit costs of instruction and scoring of buildings and physical 

equipment together represent but a small portion of the field that 

may be entered with profit. 

The length of the period of compulsory schooling is increasing, 
but it does not suffice merely to attend longer. Much needs to be 
known concerning the extent to which communities and states are 
fulfilling their obligation to (HI their children the obligation of giv- 
ing them seven to twelve years of educational opportunity of a Mnd 
which will function in self-support and a wholesome social attitude, 
We need to know not only the extent to which this opportunity is of- 
fered, but also the extent to which this opportunity is being utilized. 
Cooperative research from a university center could obtain this 
knowledge. 

We are in a time of critical questioning concerning the mater- 
ials of education and the quality of the product turned out by our 
schools. The whole field of the school curriculum is open for re- 
search. Experimental methods certainly ought to be used in de- 
termining such things as time allotment, material to be used in each 
of the various grades and the arrangement of this material through- 
out the course. It is possible that method of presentation might also 
be included. This experimentation could be advantageously di- 
rected in cooperating schools by the university research bureau. 
Each problem would be specifically stated and the technique of 
procedure worked out at the university. The bureau would have 
the constructive criticism of the faculty in education and the pre- 
liminary experimentation would be carried on in the university 
experimental school. This would prepare the way for most effect- 
ive work in the public schools which, were cooperating with the bu- 
reau. As results were secured, each advanced step would thus be- 
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to all the schools of the state. Many 

city are experimenting along of lines, 

but their are not coordinated. Cities having bmreans 

of research are doing more extensive and critical work. But under 
the leadership of the university it would be possible to conduct 
such experiments under the varied conditions of small and large 
city, with the typical schoolroom, conditions of each, and thus render 
a service to all eoHimunities in the state. 

It is not the purpose of this chapter to list all the problems 
of cooperative .research, nor to give in detail the manner of solution. 
The purpose is rather to state the aims of a research bureau in a 
university center and to note very briefly some of the larger fields 
that await attack. 

DEVELOPMENT OF THE IOWA BUREAU OF EDUCATIONAL SERVICE 

Mefhod The fundamental aims noted above have been kept 
constantly in mind in the development of the Bureau of Educa- 
tional Service in the Extension Division of the University of Iowa. 
The work was started in the fall of 1914, and the writer has been in 
charge of the work since its beginning. Some time was spent in 
traveling over the state and talking with the superintendents and 
thus learning at first-hand the most promising lines for initial en- 
deavor. 

The field had been partially prepared by courses in tests and 
measurement given in thei College of Education during the preced- 
ing two years. Schoolmen attending the University had gained 
some knowledge of school surveys and some interest in cooperative 
work. The hearty cooperation of the faculty in education has been 
one of the greatest assets of the Bureau, In classroom, in institutes, 
and at teachers' associations they have farthered the work through 
frequent reference to the Bureau and its activities* The director of 
the Bureau holds rank in the College of Education and is a member 
of the instructional staff during the summer session. He thus 
comes in contact with the 1 superintendents and principals who take 
summer work and assists in training them for further work in the 
field. 



80 r-HJB 

on supervision, held at the University 

tie of the Extension Division and the College 

of Education, has contributed much to tie development of the work. 

It has a group of school people (increasing in 

year to year) who are primarily interested in the 

of supervision. Such men as Judd, Strayer, Coffman, 

Ayres, Bagley and others have appeared upon the programs and 

the interest in scientific education. The director of the 

Bureau has had a place at one general session each year and pre- 

the results of research studies. At this conference, at the 

State Teachers' Association and at the sectional educational meet- 

each year, the director has met superintendents, principals and 
teachers in general sessions and round-table discussions. He has 
also met another group of men and women, the county superin- 
tendents. These persons, almost the only supervisors of the rural 
teachers, are becoming more and more interested in measurement 
of results^ and their cooperation is being secured. 

In a word, the secret of the development of the Iowa Bureau 
has been in the establishment of cordial cooperative relations with 
the various educational agencies of the state. 

Fields The first research problem attacked was that of at- 
tendance and the seeond,the measurement of school progress through 
the use of standard tests. In February, 1915, an arrangement was 
made with Mr. S. A. Courtis whereby the Bureau has exclusive con- 
trol of his Series B tests in the state. In November of the same year a 
similar arrangement was made for the handling of the Kansas Silent 
Reading tests. These arrangements are still in force. Meanwhile, 
the Bureau has kept a small quantity of other tests on hand and 
stood ready to secure any others upon request. In addition to fur- 
nishing the superintendents of the state with the test material at 
cost, the Bureau has stood ready to give personal service in the giv- 
ing of these tests. The writer has gone into a number of schools and 
demonstrated to the superintendents and principals the method of 
giving, scoring, and interpreting the results of these tests. This has 
resulted in the schoolmen becoming very much interested in the new 
field of tests and measurement. Many of these men and women have 
since studied at the University to increase their knowledge along 
these lines. 
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A third activity developed has an information service 

by the Bureau to give, through its contact with the 

various of the University, technical information on 

any problem connected with the schools of the state. Questions on 
buildings, heating, lighting, ventilation, playgrounds, health ser- 
vice, course of study, census, finance, etc., have come from school 
boards, superintendents, teachers and patrons, and the Bureau has 
transmitted to the inquirers the best information available. 

Another feature of the work of the Bureau has been local 
school surveys. On joint invitation of the school board and super- 
intendents, a survey of any phase of a local school problem, will be 
carefully made, the results analyzed and recommendations rendered. 
Care is taken here not to encroach upon the field of legitimate pri- 
vate enterprise. For example, service that belongs definitely to the 
field of an engineer, architect, or public accountant is not given. 

PRESENT STATUS OF WORK 

As a result of the activity of the Bureau during the three and a 
half years of its existence, its status has been quite firmly estab- 
lished. At first there was a question in the minds of many, both in 
and out of the university, whether such a bureau was a legitimate 
part of the activity of a university and perhaps even more of an 
Extension Division. At present the doubt no longer exists in Iowa. 
The Bureau, through its service to the superintendents and school 
boards, has settled this question affirmatively. 

It is understood at the University that it is the function of the 
Bureau of Educational Service to conduct researches in the field 
of education looking toward the promotion of efficiency in school 
work. All reasonable assistance will be given by various departments 
and colleges of the University to the furtherance of this work. This 
cooperation has been secured through a sincere effort to ask only rea- 
sonable assistance and to give full credit to the college, department 
or individual which rendered assistance to the Bureau. 

The relation of the school people of the state to the Bureau has 
always been that of voluntary cooperation. No system of university 
credit for work done or other means of stimulating their cooper- 
ation has been offered. At all times there has been a definite under- 
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the director of the Bureau and the superlnten- 

that each superintendent should decide for himself whether he 

to cooperate in any proposed research. If he believed that 

the of the research would be sufficiently valuable to Ms own 

to the expenditure of the time and effort required, 

the Bureau would be very glad to receive his contribution. If he 

did not believe this would be the ease.the most friendly relationship 

was maintained, and the invitation was repeated when another line 

of research work was undertaken. Thus, each superintendent in 

the has come to look upon the Bureau as asking for only such 

assistance as shall contribute directly to the solution of Ms own 

problems. 

RESULTS ACCOMPIJESHED 

The results accomplished fall rather definitely* into three 
groups, according as they pertain to (1) state-wide surveys, (2) 
local surveys, and (3) general service. 

State-wide Surveys 

(1) A state-wide survey of handwriting involving 110 cities 
and towns and rural pupils from fourteen counties was made in 
1915 and the results issued in bulletin form. 1 The following six 
questions were asked and answered on the basis of the information 
secured by the survey : 

1. How well do Iowa school children write? 

2. Do children improve their quality of writing regularly 
as they progress through the grades? 

3. Do children attending school in towns and cities write bet- 
ter than those attending the rural schools ? 

4. Do the children in the larger cities write better than those 
in towns or smaller cities! 

5. How do children in this state compare with children in 
other states! 

6. Is the quality of writing of the average eighth-grade child 
sufficient to satisfy the ordinary demands of every-day life outside 
of school? 

The samples of writing were scored by the Ayres Handwriting 

Scale 2 and the conclusions were as follows ; 



*E. 3. A&hbaugh, Handwriting of Iowa School Children, Extensfcm 
letvn,, No. 15 9 State University of Iowa. 

^Leonard P. Ayres, A Measuring Scale for Handwriting, Bussell Sage 
Foundation. 



COOPEMATirE A UNITEMSITY gg 

1. Iowa children in the eight approxi- 
mately at 30, 35, 40, 45, 50, 52, 57, and 60, respectively, 
on this scale. Reference to the scale is necessary to understand the 
means of these values. 

2. Yes. The improvement is quite uniform through the lower 
grades, but rapid in the upper. 

3 and 4. No. The differences between the quality of writing 
of children attending the rural school, small town and cities are 
negligible. 

5. On the average, Iowa children are writing as well as chil- 
dren of like grade elsewhere in the United States. 

6. Apparently the quality of writing of the majority of eighth- 
grade children will satisfy the ordinary demands of daily life, since 
75 percent of these children write a better quality than is required 
by the New York Municipal Civil Service Commission. 

(2) A similar survey of achievement in the fundamentals of 
arithmetic as measured by the Courtis Series B tests was made in 
1916 and the results distributed in a bulletin. 3 The following four 
questions were proposed and answered in this bulletin : 

1. How skillful are Iowa children in performing the four fun- 
damental operations in arithmetic? 

2. How does the skill of Iowa school children compare with 
that of children of like grades in other states! 

3. How does the skill of children in small towns compare with 
that of children in larger towns and cities! 

4. What use can be made of Standard Tests f 

1. The median speed and accuracy of children were ascer- 
tained in each of the grades. Mr. Courtis' standard as well as the 
scores of each of the cities contributing data was furnished for 
purposes of comparison. The evidence indicated that more speed 
was needed in the upper grades and greater accuracy in all. 

2. Iowa school children were shown to excel in most grades and 
operations when their scores were compared with the available 
records of sister states. 

3. While, in general, the scores of pupils in smaller towns are 
lower than those of pupils in larger places, the records of some small 
towns showed clearly that size of place is not a determining factor. 

On the basis of these showings many schools in the state have 
modified their courses in order to give greater attention to drill 
work in fundamentals. 



*E. J. Ashbaugh, Arithmetical Skill of Iowa School 
Sulietm, No 4, State University of Iowa. 
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(3) have been made of achievement in 

attendance, of absence and teachers' 

IE and spelling, the general state situation seems to 

be average or slightly above when compared with other states. 

Individual have discovered weaknesses through these surveys 

their practice accordingly. The attendance snrvey 

showed an amount of absence almost incredible to superintendents 

teachers 20 percent of the children out more than 10 percent 
of the time; 10 percent of the children out more than 20 percent 
of the time ; 6.6 percent of the children out more than 30 percent 
of the time not a satisfactory situation. High * percentages of 
attendance' have been secured through the method of dropping a 
child's name from the roll after a period of a day and a half to 
three days' absence. This, however, does not make for increased 
school attendance by the child. 

In all these studies the random selection of cities and the large 
number of pupils involved makes it probable that the results are 
typical of the state. Definite readjustments are known to have 
been made in a number of school systems on the basis of the facts 
revealed. 

Local Surveys 

(1) In response to direct invitations by superintendents and 
school boards, more or less complete surveys of four Iowa school 
systems have been made. Written reports have been rendered to 
the school boards in each case. 

(2) Building surveys involving the question of utilization of 
present buildings and the best solution for caring for the increased 
school population have been conducted in three cities. 

Local surveys are possible only by the closest cooperation with 
teachers, superintendents and school boards. Meetings with teach- 
ers are arranged where the results of the surveys of instruction are 
given and the interpretation is carefully explained. These meetings 
enable the teachers to apply the survey results so as to increase class- 
room efficiency. Meetings with the school board are also arranged 
so that information may be given them that will help them to ful- 
fill their functions to the greater good of the schools. 
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Service 

(1) The various standard tests have been furnished at cost to 

the schools of the state. This has kept the Bureau in touch with aH 
schools doing work and fostered the cooperative rela- 

tionsMp. 

(2) An informational service has been established which en- 
deavors to be a source of help in the solution of school problems. 
This service is free and open to anyone within the state. 

The response of the school superintendents of the state to 
any projected cooperative work, the large number of calls for sur- 
veys of various kinds, and the utilization of the obtained results, 
furnish, the best evidence of the value of the work that has been ac- 
complished, The fact that calls are still coming in for studies issued 
more than two years ago indicates that the work of the Bureau is 
considered as having more than temporary value. During the three 
years and a half cooperative relationship has been established with 
more than 100 different cities and towns of the state. At the pres- 
ent time I know that when an invitation is extended for cooperative 
work, a truly representative number of cities and towns can be 
relied upon to furnish, the desired information. 



A fundamental difficulty, and one that often tends to invali- 
date results, is that a large number of teachers, principals and su- 
perintendents have not had an opportunity for training in scientific 
research work. With the very best intention to cooperate, direc- 
tions are frequently misunderstood or the importance of their being 
followed in an absolute manner is not appreciated and thus a vari- 
able factor enters into the work. This difficulty can be overcome 
only by extreme care and preliminary experimentation in the for- 
mulation of directions. 

Another problem, perhaps even greater than the securing of 
reliable data, is presented by the question: How shall the results 
of researches be reported in such a way that the greatest possible 
good may come to schools I The purpose of the research is the modi- 
fication of schoolroom practice. In most cases this will be accom- 
plished only when the results reach the teacher in a form which 



66 TEE JSASBOOK 

is clear, and usable. It must be remembered that the move- 

In education in recent years is demanding a new 

type of supervisor me trained in the handling and interpretation 
of data. But until the universities, colleges and normal 

are to give us this trained corps, and a representative 
Is found in every school, it will be necessary to depend largely upon 
the classroom teacher for the application of the report to practice. 
Henee, special effort should be made, first, to present the report 
in sneh form that the ordinary teacher may clearly see its meaning 
and be inspired to utilize the results in her own classroom, and 
second, to distribute the report in such a manner that it shall come 
directly to the attention of the teacher herself. 

The difficulty of securing adequate assistance in caring for the 
work presents itself to nearly every bureau. To get reliable data 
in many studies it is often more necessary to score the papers than 
to give the tests. This requires much time and clerical assistants 
with a specific kind of training. Where the director of the bureau 
is on the regular teaching staff of the institution, he may personally 
solve this difficulty by the use of research data as laboratory mater- 
ial with Ms classes. This enables him to train his help and give Ms 
students very valuable experience with this kind of work at the 
same time. A counter-difficulty arises with this plan in that the 
director is not free for extended absences over the state as calls may 
require. 

State surveys that involve the collection of material in many 
schools and the compilation and interpretation of results at the cen- 
tral bureau present only the difficulties of securing the needed co- 
operation in the field and the necessary assistance at the bureau. 
These can be met. But local surveys present a well-nigh insupera- 
ble difficulty in the element of time. Even with a large staff, exten- 
sive local surveys could be made in only a few cities in a year. For- 
tunately, many features of a local survey can be done as well by 
the local superintendent, if he be a trained man, as by a represen- 
tative of the bureau. Hence, a partial solution to this difficulty lies 
in the training of superintendents. 
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On the of three years and a half experience with, the Bu- 
reau at the University of Iowa ? of frequent conversations "with those 
in charge of similar bureaus elsewhere, I offer the following sugges- 
tions to those who contemplate the creation of a similar bureau : 

1. The bureau should be so financed as to make available 
sufficient funds to care for the immediate tabulation of the results 
of any study conducted by it. 

2. A plan should be devised by which the director of the bu- 
reau and persons interested in its cooperative activity may meet 
for consultation one or more times during the year. These meetings 
might be arranged in connection with, the State Teachers' Associ- 
ation or other educational gathering at which a large group of 
school superintendents would be present. 

3. The director should be a member of the teaching staff of 
the university during its summer session so that through the class- 
room he may increase the interest in the work of the bureau and 
assist in the training of teachers, principals and superintendents 
for educational investigation. 

4. Eesults of researches should be presented to the public, in 
a clear and forcible manner, attractive to the lay reader and in a 
form usable by the average teacher. Specific problems should be set 
up to which specific answers are given. These problems and their 
answers at least should be intelligible to all readers, even though 
some readers may not be able to follow clearly all the processes by 
which the results are obtained. 

5. With the issuance of the studies of the bureau, arrange- 
ments should be made for a publicity campaign that will focus the 
attention of the school people upon these results. 

HISTORICAL NOTE 

Pioneer efforts along the line of cooperative investigation in 
educational measurements were made in 1910 by S. A. Courtis in 
arithmetic. One of the outgrowths of Ms activities was the taking 
over of the research work within states by state universities. The 
first university to recognize the possibilities of service through the 
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of a bureau of cooperative research was the University 
of In 1913. At this time, however, cooperative work was 

under way In the University of Indiana, and the formal organi- 
of the Bureau of Cooperative Research took place the follow- 
ing year. Similar bureaus at the University of Iowa and at the 
State Normal School, Emporia, Kansas, were organized a little later. 
A partial list of university bureaus of research, (with, sufficiently 
organizations to have stationery of their own !) is as follows : 

_ - "WTien Name of 

University Kame of Bureau Organ- Director 

ized 

Univ. of Arkansas^ Bureau of Educational 

Payette, Ark. Tests and Measure- 

ments 1917 J. E. Jewell 

Univ. of Indiana, Bureau of Cooperative 1914 (Position unfilled 

Blooming-ton., Ind. Besearch at present) 

Univ. of Iowa, Iowa City, Educational Service, Ex- 
Iowa tension Division 1914 E. J. Ashbaugh 
Univ. of Kansas, Bureau of Educational 

Lawrence, Kan. Measurements 1916 F. J". Kelly 

Univ. of Minnesota, Bureau of Cooperative 

Minneapolis, Minn. Besearek. 1915 M. E. Haggerty 

Univ. of Xebraska, Bureau of Educational 

Lincoln, Neb. Measurements 1914 Obarles Fordyce 

Univ. of Oklahoma, Bureau of Measurements 

Norman, Okla. and Efficiency 1913 W. "W. Pnelan 

Univ. of South Dakota, Bureau of Educational 

Yerniillion, S. Dak. Beseareh 1915 W. Franklin Jones 

It must not be supposed, however, that the universities that 
appear in the list above are the only ones actively supporting the 
movement. From Harvard and Columbia Universities in the east, 
to Leland Stanford Junior University in the west, from the Uni- 
versity of "Wisconsin in the north to the University of Texas in the 
south, similar work is being done by schools and departments of 
education. If a distinction is to be made at all, it is that the univer- 
sities that have formal bureaus usually act as distributing centers 
for testing material, but even this distinction does not always hold. 
The influence of university men in education has naturally been 
one of the main factors that have led to the growth of the movement. 

The university, moreover, has by no means been the only factor. 
Normal schools and teachers' institutes have done their share. At 
present bureaus of research are to be found in at least two normal 
schools : 
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When Name of 
Normal Name of Bureau Organ- Director 

ized 

State Normal School^ Bureau of Educational 
Emporia, Ks. Standards and Meas- 

urements 1914 Walter S. Monroe 

Northern Normal and Bureau of Educational 

Industrial School^ Ab- Besearcl 1017 Willis E. Jotmson 

erdeen, So. Dak. 

Still anotlier agency for the development of educational re- 
search throughout a state has been the state department of educa- 
tion. In at least three of these attention to research work is the 
special duty of a particular member of the staff. 



State 


Name of Bureau 


When Name of 
Organ- Director 
ized 


New York 
Wisconsin 

Georgia 


State Dept. of Education 
State Board of Educa- 
tion 
State Dept. of (xeorgia 


Wm. A. Avenfl 

1915 B. E, BacMaglmn 
M. L. Duggan 



Probably this is the proper place, also, to comment on the aid 
rendered by the U. S. Bureau of Education. Bulletins and reports 
of committees on standard tests and scales have been printed ; sur- 
veys have been conducted, and in many ways the Bureau at Wash- 
ington has done what it could to further the cause of measurement. 

Finally, tribute must be paid to the influence of the great foun- 
dations. The Russell Sage Foundation, through its Division of Edu- 
cation, under the direction of Leonard P. Ayres, was the pioneer in 
this field and has been one of the major influences responsible for 
the rapid development of the movement for measurement. The 
Ayres Scales in writing and spelling are widely used, while the in- 
vestigations of the Division in the field of cost-accounting and child- 
accounting have had even greater influence. The survey work car- 
ried on by the Division has be&n a third type of activity that has 
had a great effect in directing the minds of school men to the possi- 
bilities of measurement. The contributions of the foundation to 
this field are very great. 

Of recent years, more and more attention has been given by 
other foundations to the field of educational research. The Cleve- 
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land Foundation, although, of local origin and Interest, has, through 
the Cleveland Survey, made its contribution to the educational pro- 
of the country. The Carnegie Foundation has recently en- 
tered the field. 

The General Education Board, also, has given many evidences 
of its interest in the scientific study of educational problems. It 

supported the New HampsMre Bureau of Educational Re- 
search, subsidized research, work at the University of Chicago and in 
other places, conducted surveys in the Maryland and Gary schools, 
and is now carrying on an experimental school. 

It seems clear, therefore, that in the future the development 
of educational measurement should be even more rapid than in the 
past. At one extreme are great foundations willing to expend large 
sums of money for any educational investigation tliat promises to 
yield results of permanent value. At the other extreme is a vast 
army of educational workers actively engaged in teaching children 
and anxious to make use of every tool, device, or method, that will 
help them to do better work. Between the two are the universities, 
colleges and normal schools, training men both to carry on research 
work successfully and to apply the results of experimental studies 
to the practical problems of the schoolroom. 



CHAPTER VII 
EXISTING- TESTS AND STANDARDS 



WALTER S. 

Director, Bureau of Educational Measurements and Standards, Kansas State 
[Normal School, Emporia, Kansas 



During the past decade and especially during the past five 
years, the number of tests available for measuring- the abilities of 
children In school subjects has grown very rapidly. Those de- 
scribed In this chapter are as follows : 

STANDARDIZED TESTS FOB USE IN THE EMSMBNTABY SCHOOL 

Arithmetic . 17 

(Fundamental Operations 11} Iiangnage 17 

(Arithmetic Reasoning 6) Music 1 

Drawing ... . , 1 Silent Beading 13 

Geography 6 Oral Beading .. 4 

Handwriting 10 Spelling 11 

History 4. Total . . . 84 

STANDARDIZED TESTS FOB USB IN THE HIGH SCHOOL 

Algebra . , 7 History 1 

Drawing 1 Physical Training 1 

Foreign Languages 11 Physics 1 

Geometry 3 Total . . . 25 

The superintendent or teacher who wishes to measure the re- 
sults of instTOetion, faces the problem of making a wise choice from 
this material. This account of existing tests and standards has been 
prepared to assist in making this choice. Because of the limitations 
of space, only brief descriptions are possible. In the chapter pre- 
pared by Miss Bryner the reader will find references to the accounts 
of the derivation of all the tests and of their use, whenever they are 
available. Most of the tests are also described more completely in 
the writer's book on Educational Tests and Measurements, Hough- 
ton Mifflin & Company, 1917. 
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The standards given in several cases are tentative only and 
all are, of course, subject to revision. Unless standard scores are 
upon a large number of cases, they should be used with cau- 
tion in making comparisons. In all eases it should be remembered 

any standard which is simply a statement of the concensus of 
present practice is open to the criticism that we must not assume 
that what is, is what should be. For example, it may be that a high 
degree of efficiency requires a much higher standard in the rate of 
silent reading than the average rate at which children now read in 
the several grades. 

It should also be remembered that the scores upon which these 
standards are based were obtained by following certain definite 
directions in giving the several tests. Even slight variations in pro- 
cedure often materially affect pupils' scores. Hence, when compar- 
ison with standard scores is the object of the testing work, one 
should follow the standard, or specified, directions which in most 
cases accompany the tests. In any case, in making comparisons it 
Is unwise to attach great importance to small differences in scores. 1 

An effort has been made to make this list as complete as possi- 
ble, but doubtless some tests have been overlooked, and it is certain 
that within a short time new tests will be announced. In fact, sev- 
eral were found that were in the process of derivation. Certain 
special tests which have been devised for laboratory research are 
intentionally omitted because they are not available for distribution 
and in general are not suitable for the type of testing the superin- 
tendent or teacher will do. Practice tests or other exercises which 
are primarily teaching devices have also been omitted. 

The! tests may be obtained from the addresses given When no 
address is given, the tests are not available for general use. Even in 
a few eases where the address is given, the tests are not available. 
0n account of recent fluctuations in the cost of printing, prices are 
not stable. Accordingly, no prices are given. However, in only a 
few cases are the tests published on a commercial basis and for this 
reason one may be reasonably certain that the tests may be ob- 
tained at approximately the cost of printing. 

*S. A. Courtis, TJiwd, Fourth and Fifth Annual Accountings, 1918-1916. 
(Department of Cooperative Research, Detroit) . Bead especially the warning 
given on page 53. 
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STAISTDAEDIZED TESTS FOE USE nsr THE ELEMENTAEY SCHOOL, 
I. Arithmetic, Fundamental Operations 

1. Babbitt's Arithmetic Tests. These tests were used in the 
survey of the public schools of San Antonio, Texas. They consist 
of nine tests, five for the operations with integers and four for the 
operations with common fractions. Each test is limited to one op- 
eration, but contains examples of several different types. However, 
they are arranged in groups which are equal in difficulty. (Eef. 
546.)* 

2. Boston Tests. Addition of Fractions. These are a series 
of six tests devised by A. W. Kallom and are significant for the il- 
lustration they furnish of tests based upon a scientific analysis of 
the abilities they measure. This analysis revealed fourteen types 
of examples in the addition of two fractions, but by making certain 
combinations the number of tests needed to measure this group of 
abilities was reduced to six. A similar series has been devised for 
subtraction of fractions, and it is planned to extend the work to 
multiplication and division. (Ref. 78.) 

STANDABDS: BOSTON MEDIANS: ADDITION OP FRACTIONS 
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48.6 


VII 


1243 


16.5 


86.6 


10.1 


72.9 


7.3 


46.1 


5.3 


69.2 


6.3 


54.9 


5.7 


48.1 


VIII 


1130 


20.7 


88.2 


11.6 


74.4 


8.4 


47.4 


6.0 


67.8 


6.9 


52.4 


6.4 


46.5 



3. Cleveland Survey Tests. These were designed for use in 
the survey of the Cleveland Public Sehools. They have been revised 
slightly and used in the surveys at Grand Rapids and St. Louis. 
The series consists of fifteeia tests, including four in addition, two in 
subtraction, three in multiplication, four in division, and two in 
addition and subtraction of commOB. fractions. The total working 
time is 22 minutes and the administration, of the tests is simple. 
They furnish a more detailed analysis than can be secured by means 
of the Courtis Standard Research Tests, Series B. Address Charles 
H. Judd, School of Education, University of Chicago, Chicago, 
Illinois, or S. A. Courtis, 82 Eliot St., Detroit. (Ref. 403.) 

^Reference numbers in this chapter refer to the numbers in the bibliog- 
raphy, Chapter XIII. 
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AVKEAGBS OF MKDIAX SCOBES or 15 ABITHMBTIC TESTS FOB GBADES 3-8. 
AND GBAND RAPIDS. NUMBEB OF EXAMPLES BIGHT 



CLEVEI/AXD- 



| Grade 


Test | III I IV 


M | VI 1 VII ! VJLLI 


A . . 


13.4 
8.9 
6.5 
6.3 
4.3 

2.0 

2.0 


17.1 
12.8 
11.7 
11.4 
5.0 

4.5 
3.6 


21.9 
16.6 

14.8 
15.0 
5.9 

6.6 
5.1 
5.6 
1.7 
3.9 

5.6 
2.7 
3.4 
1.1 


24.9 
19.5 
16.8 
17.7 
6.7 

7.7 
5.5 
6.0 
3.1 
4.4 

7.0 
3.2 
4.1 
1.6 
3.3 


27.0 
21.1 

18.2 
20.3 

1 7A 
1 9.1 
6.0 
7.7 
4.0 
5.1 

9.4 
3.8 
4.7 
1.9 
4.3 


28.9 
25.8 
19.9 
22.8 
8.0 

10.6 
6.7 

8.6 
4.7 
6.1 

11.4 
4.4 
5.4 
2.4 
5.2 
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H ... 
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0.6 
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1.0 
3.0 

4.0 
1.7 
2.4 
0.8 
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4. Courtis Standard Tests, Series A. This series includes 
eight tests, one for the comhinations (0-9) in each of the operations ; 
copying figures, speed reasoning, fundamental operations, and reas- 
oning. The series was devised in 1909 and was used extensively 
during the following years. However, the author has discontinued 
its publication in favor of Series B, devised in 1913. (Bef. 91.) 



STANDARD MEDIAN SCOBBS, CODTRTIS' STANDARD BESBABCH TESTS, SEBIES B. 



GRADE 


Addition 


Subtraction 


Multiplication 


Division 


Speed 1 Ace. 


Speed | Ace. 


Speed | Ace. 


Speed | Ace. 


JY General 


7.4 
6 
8 

8.6 
8 
9 

9.8 
10 
10 

10.9 
11 
11 

11.6 
12 
12 


64 
100 

70 

70 
100 
70 

73 

100 

70 

75 

100 
80 

76 
100 
80 


7.4 
7 
7 

9.0 
9 
9 

10.3 
11 
10 

11.6 
12 
11 

12.9 
13 
12 


80 
100 
80 

83 
100 
80 

85 
100 
90 

86 
100 
90 

87 
100 
90 


6.2 
6 
6 

7.5 
8 
7 

9.1 
9 
9 

10.2 
10 
10 

11.5 

11 ! 
11 | 


67 
100 
60 

75 
100 
70 

78 
100 
80 

80 
100 
80 

81 
100 
80 


4.6 

4 
4 

6.1 
6 
6 

8.2 
8 
8 

9.6 
10 
10 

10.7 
11 
11 


57 
100 
60 

77 
100 
70 

8 
100 
80 

90 
100 
90 

91 
100 
90 




Boston 


*\T General 


Courtis 


Boston 


YI General 


Courtis . 


Boston. 


YII General 


Courtis 


Boston 


YIII General 


Courtis 


Boston 



Speed is the number of examples done in the time allowed. 

Accuracy is the percent of examples correct. 

"General" medians were determined by Courtis on the basis of the 1916 tabulations 
and summaries of tabulations of other years. Courtis, S. A. Third, Fourth, and Fifth An- 
nual Accountings, 1913-16. (Department of Cooperative Research, Detroit). 

The Boston standards were established after using the tests for three years. Ballou, 
P. W^ Arithmetic, the Courtis Standard Tests in Boston, 1912-15. (Bulletin No-. 10 of the 
Department of Educational Investigation and Measurement} . 
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5. Courtis Standard Research Tests, Series B. This series of 
tests consists of one test in each of the f onr fundamental operations. 
The tests measure the speed and accuracy with which the pupil 
can perform these operations with one type of example. The ad- 
ministration is very simple. The total time required to give them is 
26 minutes. They have been used extensively since their first pub- 
lication in 1914. The measures have been proved reliable in 75 
to 90 percent of the cases. Address S. A. Courtis, 82 Eliot St., 
Detroit, Michigan. (Befs. 77, 97.) 

6. GuMn's Number Tests. These tests include 88 combina- 
tions for both addition and multiplication. The standards are given 
in terms of the number of seconds required to complete the test. 
Address Hubb City School Supply Company, Aberdeen, South Da- 
kota. 

Standards. 3rd grade, 150 6th grade, 120 

4th grade, 140 7th grade, 110 

5th grade, 130 8th grade, 100 

7. Monroe's Diagnostic Tests. This series covers the four 
fundamental operations; in integers, common fractions, and decimal 
fractions. It is thought that they will furnish a reasonably com- 
plete diagnosis of the abilities of pupils to perform the operations 
of arithmetic. Although the series consists of 21 tests, they have been 
so arranged that the total time required for giving them is only 
35% minutes. Address Bureau of Educational Measurements and 
Standards, Emporia, Kansas. 

8. National Business Ability Tests. The tests for addition, 
subtraction and multiplication are abbreviated forms of the corres- 
ponding tests of the Courtis Standard Research Tests, Series B. In 
addition to these three, there are tests in multiplication of common 
fractions and in percentage. The standards are stated in terms of 
the number of minutes allowed for completing the respective tests. 
Address Sherwin Cody, Managing Director, 189 W. Madison St., 
Chicago, Illinois. 

9. Stone's Arithmetic Test for tJie Fundamental Operations. 
This test is of historical interest because it was used by Courtis 
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in the experimentation wMefa resulted in the derivation of Series A. 
It was designed as a general test and has not been standardized ex- 
cept for the sixth grade. Address Bureau of Publications, Teach- 
ers College, Columbia University, New York City. (Eel 138.) 

10. Thompson's Standardized Tests. This is an elaborate ser- 
ies of tests upon the operations of arithmetic. The feature of these 
tests is a mechanical device for scoring the papers. Address T. E. 
Thompson, Monrovia, California. 

11. Woody's Arithmetic Scales. These consist of two series 
of four tests, one for each of the fundamental operations. They 
differ from such tests as the Courtis Standard Eesearch Tests, Ser- 
ies B, in that the examples in each scale have been carefully graded 
and arranged in order of difficulty. In content they include inte- 
gers, decimal fractions, common fractions and denominate num- 
bers. 2 Series A and Series B are similar, except that Series A is 
more finely divided. Address Bureau of Publications, Teachers Col- 
lege, Columbia University, New York City. (Ref. 148.) 

TENTATIVE STANDARDS ox ACHIEVEMENT FOB WOODY TESTS, SEBIES A 
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3.12 

4.99 
6.11 
6.99 
7.95 
8.65 
9.01 


1.44 
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STANDARDS OF ACHIEVEMENT FOB WOODY TESTS, SERIES B 



Grade 
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Subtraction 


Multiplication 
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4.5 
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10 


VII 
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13 


17 


13 


VIII 


18.5 


14.5 


18 


14 



Recently there lias appeared a modification of the Woody tests 1 known as 
the Woody-MeCall Mixed Fundamentals, Series B, I and II. These tests are 
more difficult than the original Woody tests. Each sheet has on it problems in 
all four of the fundamental operations, so that the pupil must chowe the right 
operation for each problem. In exploring for tests best fitted for selecting 
gifted children in the 5th and 6th grades I have found the Woody-MeCall 
Mixed Fundamentals distinctly better than the Woody tests from which they 
were derived. G-. M. W. 
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The standards are expressed In terms of the degree of difficulty 
of the examples that are done correctly by just 50 percent of the 
pupils. 

II. Arithmetic : Reasoning 

1. Bonser's Reasoning Tests. These consist of two lists of 
ten problems each. The problems have been chosen so that the two 
tests are equal in difficulty. Address Bureau of Publications, 
Teachers College, Columbia University, New York City. (Eel 75.) 

2. Buckingham's Reasoning Tests. These tests were devised 
for use in the survey of the Gary and Prevocational Schools of New 
York City. The problems of the tests were carefully evaluated and 
arranged so that the two lists are equally difficult, but were not sci- 
entifically selected. (Eefs. 82, 466.) 

3. Courtis 9 Reasoning Tests. Tests 7 and 8 of the Courtis 
Standard Research Tests, Series A (q. v.) are reasoning tests. 

4. Rice's Reasoning Tests. These were given by Eice in 1902 
and are of historical interest. They consist of a series of tests, one 
for each of the grades from fourth to eighth, inclusive. The prob- 
lems were selected as suitable for the pupils of the respective 
grades. (Eel 129.) 

5. Starch's Arithmetical Scale A. This test consists of a 
series of arithmetical problems which are arranged in order of in- 
creasing difficulty. Address Daniel Starch, University of Wiscon- 
sin, Madison, Wisconsin. (Eel 134.) 

The following are standard scores for the ends of the respective 
years, as derived from 2515 pupils in 18 schools : 

Grade Ill IV V VI VII VIII 

Score 4.5 6.2 7.8 9.4 11.0 12.6 

6. Stone's Reasoning Test. This is a single test designed to 
be given to Grades IV to VIII, inclusive. The problems have been 
carefully evaluated. The test was used in the survey of the public 
schools of Butte, Montana, and Salt Lake City, Utah. Address 
Bureau of Publications, Teachers College, Columbia University, 
New York City. 
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Recently Stone has issued the following standards : , 
44 That 80 percent or more of 5th-grade pupils reach or exceed a 
score of 5.5, with at least 75 percent accuracy; that 80 percent or 
more of 6th-grade pupils reach or exceed a score of 6,5, with at 
least 80 percent accuracy; that 80 percent or more of 7th-grade 
pupils reach or exceed a score of 7.5, with at least 85 percent accur- 
acy ; that 80 percent or more of 8th-grade pupils reach or exceed 
a score of 8.75, with at least 90 percent accuracy." (Eel 139.) 

III. Drawing 

1. TJwrndike's Drawing Scale. This scale, devised by E. L. 
Thoradike, In 1913, consists of a series of drawings arranged in 
order of merit as determined by competent judges. Address 
Bureau of Publications, Teachers College, Columbia University, 
New York City. (Bel 159.) 

IV. Geography 

1. TJie Boston Tests. The two tests of this series one on the 
United States and the other on Europe consist of well-chosen 
questions. The relative difficulty of the questions was determined 
upon the basis of the percent of correct answers. The tests were 
devised in an effort to determine: (1) the character of achieve- 
ment in geography and (2) the possibility of scientific measurement 
of educational results in geography. This significant comment is 
made: "The results show how inadequate the customary examina- 
tion or test in geography is to measure ability in geography." 
(Bel 216.) 

2. Buckingham's Geography Test. This test was devised for 
use in the survey of the Gary and Prevocational Schools of New 
York; City. It consist of two sets of 20 questions which were eval- 
uated upon the basis of the percent of correct responses. (Eef. 
466.) 

3. HaJin-Lackey Geography Scale. This scale consists of sev- 
eral hundred geographical questions which were found to be com- 
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mon to six modern texts and which satisfied certain other criteria. 
These questions have been classified according to difficulty. In 
appearance the scale is very much like the Ayres' Spelling Scale 
and is to be used the same way. Address H. H. Hahn, Wayne State 
Normal School, Wayne, Nebraska, 

4. Starch's Geography Tests, Series A. The common elements 
of five geography texts have been arranged in five parallel tests. 
The exercises of the tests are in the form of mutilated sentences. 
Address Daniel Starch, University of Wisconsin, Madison, Wiscon- 
sin. 

5. Thompson's Standardized Tests in Geography. These con- 
sist of a test each for North and South America. They deal en- 
tirely with place geography. An important feature is a mechanical 
device for scoring the papers. Address T. E. Thompson, Monrovia, 
California. 

6. Wifham's Standard Geography Tests. These are a series 
of tests arranged to test quickly and easily pupils' knowledge of 
certain geographical facts. The facts for the tests on the world 
are grouped under these heads: (1) geographical divisions, (2) 
form and motion of the earth, (3) the hemispheres, (4) land and 
water forms, (5) homes of the races, (6) industries, and (7) largest 
cities. Address E. C. Witham, Southington, Conn. (Eef . 221.) 

V. Handwriting 

The scales described below are used to measure the quality of 
handwriting. The speed of handwriting is measured by having 
suitable material written under specified conditions for a definite 
number of minutes. In order that a measurement of speed may be 
most significant, it must be made when the quality of the pupiPs 
handwriting is approximately standard. 

' ' Pupils should be asked to write a suitable selection which they 
have memorized. To guard against lapses of memory, the pupils 
should be asked to repeat in concert the selection to be used. If 
convenient, it is well to provide each pupil with a printed or type- 
written copy of the selection. When this cannot be done, the se- 
lection may be written on the blackboard where all can see it. The 
selection should contain no words which the pupils cannot spell 
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readily. It is well to have them practice writing the more difficult 
words before the test is begun. Do not use material which the pu- 
pils must compose as they write, for this would be worthless in test- 
ing. The rate of writing unfamiliar material from a printed copy 
will vary with the pupils 7 rate of reading and so will not give a 
true measure of speed. Dictated material should be used only 
when the teacher wishes to control the speed, not when speed is to be 

measured. 

"Different investigators have required pupils to write different 
material. Several have used the first line or the first stanza of the 
poem, 'Mary had a little lamb.' 'Sing a Song of Sixpence 3 has 
been used. Other sentences which have furnished copy are 'Jolly 
Mngs bring gifts while happy maids dance.' 'A quick brown fox 
jumps over the lazy dog/ 3 'Then the carelessly dressed gentleman 
stepped lightly into Warren's carriage and held out a small card. 
John vanished behind the bushes and the carriage moved along 
down the driveway. 74 In the Cleveland Survey the first three sen- 
tences of Lincoln's Gettysburg Address were written, and Ayres 
has used the same selection in the * Gettysburg Edition' of Ms scale. 
In several surveys the pupils were allowed to write any familiar 
stanza of a poem. The chief principles to bear in mind in selecting 
materials are: first, to use material in the lower grades which, will 
not furnish difficulties in spelling and remembering; and second, 
to use material which, will be uniform in all classes which, are to 
be compared. 7 ?5 

1. Ayres' Scale for Measuring the Handwriting of School 
CJiildren. This is known as the "Three Slant Edition/' or more 
simply as the Ayres Scale. It consists of three types of specimens 
of the handwriting* of school children vertical, semi-slant and full 
slant arranged in order of legibility as determined experimentally. 
The values 20, 30, 40, up to 90, have been assigned to the specimens. 
This scale has been used very widely. Address Russell Sage Foun- 
dation, New York City. (Eef. 227.) 

3 TMs sentence was used in securing specimens for the Freeman. Scale. It 
contains all the letters of the alphabet. 

*These sentences were used in securing the specimens for the Thomdike 
Scale. 

Walter S. Monroe, 'Educational Tests and Measurements, p. 146. Houghton 
Mifflin Company, 1917. 
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2. Ay res' Scale for Measuring fhe Quality of Handwriting of 
Adults. This scale Is similar to that described above, except that 
specimens of the handwriting of adults are used instead of the 
handwriting of school children. Address Russell Sage Foundation, 
New York City. (Eel 229.) 

3. Ay res' "Gettysburg Edition.'* This scale differs from the 
other two in certain important characteristics. It consists of speci- 
mens of school children's handwriting on ruled paper and there is 
only one specimen for each division of the scale instead of three 
representing different degrees of slant. The copy, the first three 
sentences of Lincoln's Gettysburg Address, is the same for all spec- 
imens. The scale has printed on it standards for both speed and 
quality and complete directions for its use. Ayres asserts that the 
purpose of the new features is "to increase the reliability of meas- 
urements of handwriting." Address Russell Sage Foundation, New 
York Gity, 

4. Breed and Downs' Scale. This scale was constructed in 
making a survey of the handwriting in the public schools of High- 
land Park, Michigan. The specimens were scored by means of the 
Thorndike Scale and then certain ones selected for a five-step scale 
for each of the following grades, 3d A, 3d B, 4th A, 5th A and 6th 
A. Thus, it differs from other scales in having a special scale for 
each of the grades named. (Ref. 234.) 

5. Courtis' Standard Research Tests, Handwriting , Series W. 
Test I, Handwriting, is an untuned "maximum performance" test, 
designed to secure samples of the children's best writing after prac- 
tice. Test II, Filing Test, is a "free-choice" copying test, designed 
to secure samples of the children's writing under working condi- 
tions. The test consists of the names and addresses of ten business 
firms, to be copied in alphabetical order. In both tests the quality 
of the writing is to be measured with the Ayres scale. The differ- 
ence in quality between the two samples reveals any "lack of trans- 
fer" from the work of the writing class to ordinary writing. The 
material in the Filing Test has been so chosen as to afford excellent 
material for an analysis of the defects in the writing of a particular 
child. Address S. A. Courtis, 82 Eliot Street, Detroit, Michigan. 
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6. Freeman's Handwriting Scale. TMs scale differs from the 
others in that there is one scale for each of the following character- 
istics of handwriting: (1) uniformity of slant, (2) uniformity of 
alignment, (3) quality of line, (4) letter formation, and (5) spac- 
ing. Only three degrees of each characteristic 1, 3 and 5, are in- 
cluded in the scale, although the intermediate values, 2 and 4, may 
be used. TMs scale is designed for diagnosis rather than general 
measurement. Address Houghton Mifflin Company. (Bef. 240.) 

7. Gray's Score Card. TMs score card is of the same general 
character as those wMch are used in judging grain and livestock. 
It is "based upon a determination of the important characteristics 
of handwriting. Its function is similar to that of the Freeman scale, 
i. 6., to furnish a diagnosis rather than a general measurement. 
Address C. T. Gray, University of Texas, Austin, Texas. (Ref. 245.) 

8. Johnson and Stone's Scale. TMs scale is similar in gen- 
eral plan to the Ayres and Thomdike Scales, but based on several 
factors, including movement and a detailed analysis of legibility. 
Each specimen, of the scale is accompanied by a legend which states 
its defects and merits in terms of the analysis appended, wMch in- 
cludes seven factors letter formation, uniformity of slant, uni- 
formity of alignment, spacing, quality of line, size, and degree of 
slant. (Bef. 247.) 

9. TJiorndike's Scale. TMs scale was constructed on the basis 
of three characteristics beauty, legibility, and general merit. The 
degree of these characteristics represented in the specimens of the 
scale was determined by the concensus of opinion of competent 
judges. The numerical values of the specimens of the Thorndike 
Scale range from 4 to 18, and one or more specimens are given for 
each degree of quality. Address Bureau of Publications, Teachers 
College, Columbia University, New York City. (Bef. 263.) 

10. Zaner and Blossom Handwriting Scales. These are a 
series of scales for the several grades, designed to be used with a 
particular system of handwriting. Address Zaner and Blossom 
Co., Columbus, OMo. 
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Source 


Grades 


Approximate num- 
ber of specimens 
scored 


n i in 1 iv 


V 


vi 1 vn Ivra 


Cleveland 
Iowa Schools 7 . . . 
Starch's Standard 8 

Kansas Medians 9 
Fifty-six cities 10 . . 
Freeman's 
Standards 


39.2 
39.2 
31 
32 
30.6 

36 


49.2 
38 
35 
43.8 

48 


61.9 
47 
51 
51.2 

56 


60 
65.5 
57 
61 
59.1 

65 


70 
72.6 
65 
67 
62.8 

72 


76 

75 
75 
71 
67.9 

80 


80 
76.5 
76.5 
73 

73 

90 


25,387 
28,000 

4,740 
6,000 
34,000 



STAKDABD MEDIAN SCOBES: QUALITY OF HANDWRITING 



Source 


trades 


Scale 
used 


Approxi- 
mate number 
of specimens 
scored 


H 


HI 1 IV ] V 


VI 


VII | VIII 










45 
49.1 
43 
55 
50.5 

55 
11.1 

8.9 

10.3 
10.76 


48 
52.3 

47 
59 
54.5 

59 
11.3 

11.6 

11.7 
11.34 


50 
57 
53 
64 
58.9 

64 
12.2 

11.2 
10 

11.7 

11.89 


55 
55 
57 

70 
62.8 

70 
12.8 

12.1 

11 
12.66 


Ayres 
Ayres 
Ayres 
Ayres 
Ayres 

Ayres 
Thorn- 
dike 
Thorn- 
dike 
Thorn- 
dike 
Thorn- 
dike 


25,287 
28,000 
4,740 
6,000 
34,000 

2,500 
1,400 
1,200 




35.7 
27 
44 
39.7 

44 


39.8 
33 
47 
42 

47 
9.2 

8 

10.3 
9.75 


44.{> 
37 
50 
45.8 

50 
10.7 

8.8 

10 
10.13 


Starch's Standard .... 




Freeman's Standards . . . 
(Ayres Scale) 


Butte Montana 12 


8.2 








Freeman's Standards 
(Thorndike's scale) . . . 


9.36 



VI. History 

1. Buckingham's Tests. These tests were used in tlie survey 
of tlie Gary and Prevocational Schools of New York City. They 
consist of two sets of questions which have been evaluated on the 
basis of the percent of correct answers. More recently BucMng- 

6 Jndd, Charles H., Measuring the Work of the Public Schools. Meport, 
Survey Committee on the Cleveland Foundation, 1916. 

7 Ashbaugh, E. J., Handwriting of Iowa School Children. University of 
Iowa, Extension Division, Bulletin No. 15, March 1916. 

8 Starch, D., The Measurement of Efficiency in Beading, Writing, Spelling, 
and English. University of Wisconsin, 1914:. 

9 DeYoss, J C. Second Annual Report of Bureau of Educational Measure- 
ments and Standards. Kansas State Normal School, Emporia, Kansas. 

10 Freeman, F. 1ST., Fourteenth Yearbook of this Society, Part I, 1915. See 
also the Sixteenth Yearbook, Part I, 1917, Ch. IV. 

^Report of a Survey of the Schools of Salt Lake City, Utah, (1915). 

^Report of a Survey of the Schools of Butte, Montana, Ch. TV (1914). 

18 Witham, E. C., All the Elements of Handwriting Measured. Educational 
Administration and Supervision, 1; 1915, pp. 313-24. 

14 Wilson, Gr. M., The Handwriting of School Children. Elementary School 
Teacher, 6; 1911, pp. 4=50-53. 
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ham has studied the relation between the ability to remember Ms- 
torieal facts and the ability to use them. In this study specially 
devised tests were used. (Kef. 466.) 

J. The Bell and McCollum Test. This test consists of a series 
of questions which have been very carefully selected because of their 
importance. The topics included are: (1) dates-events, (2) men- 
events, (3) events-men, (4) historic terms, (5) political parties, 
(6) divisions of history and (7) map-study. The test can be ad- 
ministered in a forty-minute period. (Eef. 270.) 

3. Harlan's Test of Information in American History. This 
is a test of historical information based upon the study of Bagley 
and Bugg, "The Content of American History Texts/ 7 Address 
Chas. L. Harlan, College of Education, University of Minnesota, 
Minneapolis, Minn. 

4. Starch's American History Tests, Series A. This test is 
based upon the facts and principles common to five modern texts. 
The exercises are in the form of mutilated sentences. Four dupli- 
cate forms are available. Address Daniel Starch, University of 
Wisconsin, Madison, Wis. 

VII. Language 

1. Breed and Frostic Scale. The compositions used by Breed 
and Frostic in deriving their scale were written by sixth-grade 
pupils under uniform conditions. A part of a story called The Pic- 
nic was read to the class, and they were given 20 minutes to com- 
plete it. The method of selecting compositions for the scale and 
determining scale values, was similar to that employed by Hillegas. 
(Eef. 165.) 

2. Courtis Standard Tests in English. See Reading, below. 

3. Harvard-Newton Composition Scale. The Harvard-Newton 
Composition Scale consists of four separate scales, one for each form 
of discourse ; argumentation, description, exposition, and narration. 
Each of the scales consists of six compositions written by eighth- 
grade pupils and arranged in order of merit as determined by the 
marks assigned by teachers, rating them as eighth-grade composi- 
tions. For each composition there is given a statement of the most 
significant merits and defects. Address Harvard University Press, 
Cambridge, Mass. (Eef. 161. ) 
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STAXDABDS. MEDIAN SCOBBS FOB HABVAEB-KBWTON SCALE 



Grade 


Number of Composition 


Median Scores 


Vllb 
Vila 


67 

72 


60 
64 


VTTIb 


68 


66 


Villa 


61 


69 


IXb 


57 


68 


IX 


61 


63 



4. Hillegas Scale for tlte Measurement of fke Quality in Eng- 
lish Composition for Toung People. This consists of ten composi- 
tions ranging from an artificial production, whose scale value is 
zero, to the tenth composition, whose scale valne is 9.3. Three of 
the ten compositions are artificial productions, five were written by 
high-school pupils, and the remaining two by college freshmen. No 
two were written on the same topic and they vary greatly in length 
and type. Each degree of merit is represented by only one com- 
position. (Eel 172.) 

STANDARDS FOB THE HIKE/EGAS SCALE 



Grade 


Salt Lake 
City 


Butte 


Trabue: 
Median 
Score 


Trabue: Score above 
which, three-fourths of 
pupils should rank 


rv 


2.9 


2.34 


3.5 


3.0 


V 


3.1 


2.87 


4.0 


3.5 


YQ; 


3.8 


3 40 


5.0 


4.0 


VU 


4 4 


3.75 


5.0 


4.5 


VHI 


5.4 


4.11 


5.5 


5.0 


IX 






6.0 


5.5 


x 






6.5 


6.0 


XI 






6.9 


6.4 


xn 






7.2 


6.7 



5. Nassau County Supplement. The Nassau' County Supple- 
ment to the Hillegas Scale consists of nine compositions, seven of 
which were written by elementary-school pupils on the topic * 'What 
I should like to do next Saturday." The compositions of the scale 
were carefully selected and evaluated by an elaborate method which 
cannot be even sketched here. Copies may be obtained from the 
Bureau of Publications, Teachers College, Columbia University, 
New York City. (Eel 203.) 

6. Tlwrndike's Extension of the Hillegas Scale. This exten- 
sion is similar to the original scale, except that a larger number of 
compositions have been used, thereby making a more finely divided 
scale as well as providing several compositions for each degree of 
merit in the middle of the scale. Address Bureau of Publications, 
Teachers College, Columbia University, New York City. 
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7. The Trabue Completion-Test Language Scales. Trabue 

has devised a series of Completion-Test Language Scales for the 
general measurement of language ability. Bach scale consists of 
sentences from which one or more words have been omitted. The 
position of the omitted words is indicated by a blank. The pupil is 
to write in the missing words. The relative difficulty of the sen- 
tences has been carefully determined, and they have been arranged 
in order of difficulty. It is claimed for these tests that a pupil's 
"language ability " is very closely related to his score on these 
scales. Copies may be obtained from the Bureau of Publications, 
Teachers College, Columbia University, New York City. (Bef. 202.) 

: TRABTTE COMPLETION-TEST SCALES 



Grade 


Median 


Chrsde 




II 


. 3.0 

60 


VlII 
IX 


14.2 


TTT 


8 


X 


15.3 




9 6 


XI 


15.8 


TTT 


11 


xn 


16.2 


VII .... 


12.3 







8. Witting's Scale. Willing used compositions written by 
pupils in Grades four to eight on the topic "An Exciting Experi- 
ence. " Several particular exciting experiences were suggested, and 
20 minutes was allowed for writing. In determining the composi- 
tions to be used for the scale, "all errors in spelling, punctuation, 
capitalization and grammar were counted and corrected/' The 
compositions selected as samples for the scale were those which had 
the same rank in "story value" and frequency of errors. Ad- 
dress Bureau of Measurements and Standards, Emporia, Kansas. 
(Refs. 504, 513.) 

For the Denver Survey the following median scores were ob- 
tained: 



Grade . . . . 
Median . . 



4th A 
31.5 



5th. A 
43.4 



6th A 
50.9 



7th A 
60.2 



8t,h A 
63.4 



9. Buckingham's Grammar Test. In making the survey of the 
Gary and the Prevocational Schools of New York City, Bucking- 
ham used a series of questions upon English grammar. These ques- 
tions were carefully evaluated upon the basis of difficulty. They 
have been re-arranged and published by Haggerty. (See below.) 
(Ref. 466.) 
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10. Charters' Grammar Test. This test consists of sentences 
containing an incorrect form. The pupil is to write the sentence in 
tlie correct form and give tlie grammatical reason for doing so. The 
incorrect grammatical forms were selected from the errors occur- 
ring in the oral and written speech of pupils. Address W. "W". Char- 
ters, University of Illinois, Urbana, Illinois. 

11. Haggerty's Grammar Test. Same as Buckingham's, with 
the questions re-arranged and printed in convenient form. Ad- 
dress Bureau of Cooperative Research, University of Minnesota, 
Minneapolis, Minnesota. 

12. National Business Ability Tests. These include two tests 
on grammatical form and one on punctuation. In the grammar 
tests the pupil is to choose between two forms which are given. Ad- 
dress Sherwin Cody, Managing Director, 189 West Madison St., 
Chicago, Illinois. 

IS. Starch's Grammatical Scales. Starch has devised three 
scales (A, B, and C) to measure a pupil's ability to use correctly 
certain language forms. His Grammatical Scale A consists of a 
series of exercises arranged in order of increasing difficulty. As 
tentative standards of attainment Starch gives the following scores 
for the use of these scales (Eef . 214) : 

Grade. VTI VIII IX X XI XII Freshmen 

Score 8.0 8.3 8.6 8.9 9.2 9.5 10.3 

14. Starch's Punctuation Scale. Starch has also devised a 
Punctuation Scale which is similar in form to the Grammatical 
Scales. The exercises consist of sentences to be punctuated. The 
following are tentative standard scores of attainment for the ends 
of the respective school years : 





Grades f 


High School 


| University 


Year 


7 
8.0 


8 
8.3 


8.6 


2 
8.9 


3 
9.2 


4 I 3 
9.5 | 10.3 


Score 



15. Starch's Grammatical Tests. Starch has also devised three 
tests for measuring directly a pupil's ability to recognize certain 
language forms. In Test 1 the pupil is asked to mark the part of 
speech of each word in a certain printed text. His score is the num- 
ber he designates correctly in three minutes. Test 2 calls for the 
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designation of the case of the nouns in another printed test. Test 3 
has to do with the tense and mode of verbs. 

STANDABDS: STABCH'S GEAMMATICAII TESTS 



j Grades \ 


High 


School 


\ 


University 


Tear. 

Score, 
Scare, 
Score, 




7 
30 
13 
13 


8 
33 
16 

16 ' 


1 
36 
20 
20 


2 
40 
23 
23 


3 
43 
26 
26 


4 \ 
46 I 
30 I 
30 { 


3 
60 
45 
45 


Test 1 


Test 2 


Test 3 



Address Daniel Starch, University of Wisconsin, Madison, 
Wisconsin. 

1. Thompsons Research Test in Grammar. This is a test 
of the pupil's ability to indicate the part of speech in a list of words. 
The feature of the test is a mechanical device for scoring the papers. 
Address T. B. Thompson, Monrovia, California. 

17. Boston Copying Test This test was devised to measure 
the ability of pupils to copy printed matter. In giving the test, 
each pupil was provided with a printed selection which he was asked 
to copy with pen and ink. In marking the papers the following er- 
rors were noted: in spelling, capitalization, punctuation, undotted 
i ? s, uncrossed t's; in omitting words, in adding words, in wrong 
words used, and in misplaced words. (Ref. 164.) 

The errors noted consisted of nine different kinds, and the num- 
ber of each kind made in this test by 4494 pupils is shown by the 
following tabulation : 

Spelling 5,829 

Capitalization 644 

Omitted words 4,077 

Added words 606 

Wrong words used 840 

Misplaced words 105 

Punctuation 5,876 

Undotted i's 8,794 

Uncrossed t's 606 



Total 27,377 

Average errors per pupil 5.54 
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VIII. Music 

1. Seashore's Musical Talent Chart. TMs chart is based upon 
tlie analysis of musical ability and offers a grapHc means of rep- 
resenting the pupil's musical ability. Address Carl E. Seashore, 
University of Iowa, Iowa City, Iowa. 

IX. Silent Beading 

1. Brown's Silent Reading Test. TMs test consists of a very 
interesting reading selection, which is used in Grades III to VIII. 
Duplicate selections of equivalent difficulty are obtainable. The 
directions require that the children read the selection silently for 
exactly one minute, then draw a line around the word which they 
have reached when the examiner calls "Stop." The number of 
words read makes the score in speed. 

The children are then asked to write as much as they can re- 
member of what they have read, A key is provided for the exam- 
iner to use in scoring the papers. On it are listed all the separate 
ideas contained in the selection. By comparing the child's papers 
with the key, the examiner determines how many different points 
there are in what the child read. Then Ms reproduction is exam- 
ined carefully to determine (1) quantity and (2) quality of com- 
prehension. Address, Bureau of Eesearch, 25 Capitol St., Concord, 
New HampsMre. (Refs. 286, 287, 288.) 

STANDARDS: TENTATIVE SOOBES WITH THE BBOWN SILENT READING TEST 



1 


Words per Second 


Comprehension 


Reading Efficiency 


Grade III 


3 32 


46 


127 8 


Grade IV 


3 55 


65 


217 1 


Grade V 


440 


61 


291 


Grade VI 


4.54 


68 


295 


Grade VII 


465 


78 


322.3 


Grade "VTII 


4.84 


79 


323.6 



2. Courtis Standard Research Tests in English. These are a 
series of tests devised by Courtis to measure speed and comprehen- 
sion of silent reading. The series of tests was so complex that the 
marking of the test papers was a laborious task. For tMs reason 
the publication of the tests has been discontinued, (Eef. 291.) 

3. Courtis Eesearch Tests Silent Reading (Series R, Test 2). 
This test is suitable for Grades I to VI. It measures a phase of read- 



90 TBS SEVENTEENTH YSAEBOOK 

ing ability acquired in Grades II, III, and IV. In the first part of the 
test the cMldren read a simple child's story under normal condi- 
tions. Prom this work a measure of the rate of reading is derived. 
In the second part of the test the paragraphs of the story are re- 
printed and under each are given five simple questions about the 
paragraphs. The questions may be answered by "yes" or "no" 
and they are designed to measure a child's comprehension of the 
relation existing between the essential elements of the story. The 
tests are available in two forms of nearly equal difficulty, so that 
measurements may be made at the beginning and end of the year. 
Address S, A. Courtis, 82 Eliot Street, Detroit, Michigan. (Kef. 
293.) 



COTJBTIS SUdSSTT READING.* SEBIES R, TEST 2 

(Median Grade Scores at the end of the Tear) 



Grade ........................ II HI IV V VI 

Scores ............... ... ...... 84 _ 113 _ 145 _ 168 _ 191 

4. Fordyce's Scale for Measuring fke Achievements in Read- 
ing. This scale consists of a selection to be read, upon which the 
pupils are required to answer certain questions that have been 
weighted for determining the comprehension score. The speed of 
reading is found by having the pupils mark the word they have 
reached at the end of the stated interval. In order that all may 
have the information necessary for answering the questions, the 
pupils are then directed to finish the story. Address the Univer- 
sity Publishing Co., Lincoln, Nebraska. 

STAN-DABDS IN PERCENTS : FORDYCE SILENT BEADING TEST 



Test No. 1, designed for Grades III, IV and V. 


HI 


IV 


V 


Speed 


90 


95 


100 


Quality 


57 


71 


74 


Test No. 2, designed for Grades VI, VII and VHI. 
Grade . 


, VI 


VII 


vm 


Speed 


. . 90 


100 


100 


Quality 


41 


45 


50 



5. Gray's Silent Beading Tests. These tests consist of three 
selections, one for Grades II and III, one for Grades IV, V, and VI, 
and another for Grades VII and VIII. The selections are so ar- 
ranged on the pages that the time required to read one hundred 
words can be readily ascertained. Only one child is tested at a time. 
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After completing tlie reading, tlie child, if in the second or tMrd 
grade, tells tiie story to tlie examiner, who writes it down. In the 
grades above the third, the child writes all he can remember of the 
story, and then writes answers to a set of questions which is fur- 
nished him by the examiner. The child's score for quality of read- 
ing is assigned on the basis of two factors, reproduction and ac- 
curacy. Reproduction is determined by the number of words which 
remain in the child's composition, after all wrong or irrelevant 
statements and repetitions are stricken out. Accuracy is deter- 
mined on the basis of ten points for each correct answer. The 
quality mark is the average of these two. Address William S. Gray, 
School of Education, University of Chicago, Chicago, Illinois. 
(Refs. 297, 300a.) 

STANDARD SCOBES I-OE G-EAT'S SILENT READING TESTS 

Grade I II | IH | IV | V | VT | VII | VIII 

Bate (words per second) 1.50 I 2.30 j 2.20 j 2.57 I 2.79 I 2.69 2.87 

Quality I 32 j 37 | 29 | 32 | 39 | 22 } 27 

6. Haggerty's Visual 'Vocabulary Tests. The tests prepared 
by Haggerty, of the Bureau of Cooperative Eeseareh, School of 
Education, University of Minnesota, are but a slight modification 
of the Thorndike Visual Vocabulary Scales, with the addition of 
an oral test for children of Grades I and II. This test will be de- 
scribed under the heading of " Oral Reading/' Scale E2, of which 
there is one sheet for children of Grades III and IV and another 
sheet containing part of the same words and additional more diffi- 
cult words for Grades V, VI, VII and VIII, is devised in exactly 
the same way as the Thorndike scales. Methods of scoring are 
somewhat more simple, and the lists are briefer than those used by 
Thorndike. Forms of equivalent difficulty are obtainable. Ad- 
dress Bureau of Cooperative Besearch, University of Minnesota, 
Minneapolis, Minnesota. (Eef. 301.) 

7. Kansas Silent Reading Tests. These tests were devised by 
F. J. Kelly. Both speed and comprehension of reading are com- 
bined in a single mark. These tests consist of graded lists of exer- 
cises which have been carefully evaluated. Each exercise consists 
of the directions for doing something, which is very simple after 
the pupil has fully understood the directions. His comprehension 
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of the exercise Is measured by what lie does. Test I is for Grades 
III, IV, and V; Test H for Grades VI, VII and VIII ; Test III for 
Grades IX, X, XI, and XII. Address Bureau of Educational 
Measurements and Standards, Emporia, Kansas. (Eefs. 314, 315.) 

MEDIAE SCORES, KANSAS SILENT BEADING TESTS 
(Based upon more than 100,000 Scores) 



III f IV 



vn I viu I ix 



xi 



Twenty-five 
percentlle . . 
Median Score 
Seventy-five 
percentlle . . 


2.5 
5.3 

8.2 


6.1 
9.5 

13.6 


9.4 
13.2 

17.5 


9.4 
13.9 

19.8 


11.8 
16.2 

21.9 


13.7 
19.2 

26.4 


16.0 
22.9 

30.4 


17.9 
25.6 

31.9 


18.7 
26.5 

33.1 


22.3 
29.7 

34.1 



8. TJie Minnesota Scale Beta. TMs is slightly modified form 
of Tkoradike's Scale Alpha (q. v.) It is printed in a form which 
is more convenient for use. This scale is issued in two forms which 
are approximately eqnal in value. Address Bureau of Cooperative 
Eeseareh, University of Minnesota, Minneapolis, Minnesota. 

9. Monroe's Standardised Tests in Silent Reading. In these 
tests those features of the Kansas Silent Beading Tests which have 
proved satisfactory have heen incorporated. The exercises have 
heen secured from school readers and other books which children 
read. Test I is for Grades III, IV and V; Test II for Grades VI, 
VII, VIII ; Test III for Grades IX, X, XI, and CKIL These tests 
are issued in three forms which are equivalent in value. Address 
Bureau of Educational Measurements and Standards, Emporia, 
Kansas. 

10. Starch's Silent Reading Tests. These tests are similar to 
Brown's Silent Beading Tests described above, except that differ- 
ent selections are used for the different grades. Address Daniel 
Starch, University of Wisconsin, Madison, Wisconsin. 

STANDARDS: MEDIAN SOOBES IN STABCH SILENT BEADING TESTS 
(Attained at the Close of the Respective Tears) 



Grade or Tears ^ 


I 


n 


ni 


IV 


V 


VT I VII | VIII 


Speed (words per second) . . . 
Comprehension 
(words written) 


1.5 
15 


1.8 
20 


2.1 
24 


2.4 
28 


2.8 
33 


3.2 | 3.6 | 4.0 

38 1 45 1 50 



11. Starch's English Vocabulary Tests. These tests are lists 
of one tnndred words, each selected at random from a dictionary. 
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Tiie child is asked to check the words, the meaning of which he is 
certain, and to write the meaning after the words of which he is 
in doubt. The score is the percent of words thus checked or cor- 
rectly defined. These tests measure the extent of the pupil's vocab- 
ulary, regardless of the value of the words. Address Daniel Starch, 
University of Wisconsin, Madison, Wis. 

The following are tentative standard scores for the various 
years as determined from tests made in four schools (Bel 333) : 

Elementary High School University 

Years 4 5 6 7 8 12 3 4 12 3 4 

Scores 30 33 36 39 42 45 47.2 50 53 56 58.5 61 63 

12. Tliorndike's Visual Vocabulary Scales. Thorndike is the 
author of three visual vocabulary scales: Scale A, Scale A2 and 
Scale B. The latter two represent extensions of the former, and 
were derived by the same method. Scale A2 and Scale B are in- 
tended for use alternately or interchangeably, and each is issued in 
three forms. Each scale consists of graded lists of words, the mean- 
ing of which the pupil is to indicate by assigning the words to 
certain classes. Address Bureau of Publications, Teachers Col- 
lege, Columbia University, New York City. 

Standards : No standards have as yet been derived by the use 
of the Thorndike Scale A2 or Scale B with large numbers of public 
school children. In the following table the standards of achieve- 
ment by the use of the Thorndike Scale A (with which the values 
on Scales A2 and B are supposed to be identical) are given, and 
serve as tentative standards for purposes of comparison. The score 
values were obtained by the measurement of the pupils in 18 cities 
in Indiana. (Refs. 336, 342.) 

MEDIA]*" SCOBES I3ST VlSTJAJQ VOCABTHLABY BY THE THORtfDIXE SCALE A 

grades I in | iv I v I vi I vn I vm 

Median Score 1 4.00 I 5.26 I 6.00 I 6.66 J 7.29 | 7.91 

Number of Children . . ...| 1650 | 2095 | 2028 | 1860 | 1625 j 1313 

13. TJiorndike's Scale Alpha and Alpha, 2 for Measuring the 
Understanding of Sentences. Scale Alpha 2 is a slightly more elabo- 
rate edition of Alpha. Each scale consists of a carefully graded 
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series of paragraphs. Each paragraph is followed by several ques- 
tions which the child is to answer as he reads the paragraph. The 
pupil *& answers to the questions determine the measure of his com- 
prehension. In the Teachers College Record which describes the 
derivation of this scale, there is given a score card for marking the 
answers to these questions. Address Bureau of Publications, 
Teachers College, Columbia University, New York City. (Eefs, 
340 ? 348.) 

The following table gives the median scores for the pupils in 
18 cities in Indiana, as reported by Haggerty. 

MJEDIA27 SCOBES 33T UlTDEBSTANDZXTG OF SENTENCES BY THE THOBNDEKB SCALE 



Grades 


I in 


IV 


V 


VI | 


VII 


VIII 


Median 


j 5.48 


6.56 


7.56 


8.46 1 


8.72 


9.00 


dumber of pupils . . 


. ...( 1650 


2095 


2028 


1860 | 


1625 


1313 



X. Oral Reading 

1. ffray's Oral Reading Test. This test consists of twelve para- 
graphs, arranged in order of increasing difficulty. The relative dif- 
ficulties have been established experimentally. The* child *s oral 
reading of each paragraph is checked for time, and for each of six 
types of errors: gross errors, minor errors, omissions, substitutions, 
insertions, and repetitions. Address William S. Gray, School of 
Education, University of Chicago, Chicago, Illinois. (Eef. 297.) 

2. Haggerty's Visual Vocabulary Tests. For Grades I and II 
these consist of two sheets, one of eight words and the other of 
phonetic words selected from the Jones test. .The words on either 
sheet are grouped into lists according to difficulty. This difficulty 
was determined by trial with several hundred primary children. A 
value is attached to each word according to its ascertained difficulty. 
The child is asked to pronounce the words aloud ; his score is the 
value attached to the most difficult list of which he can pronounce 
four out of five words correctly. Two equivalent forms are avail- 
able. Address Bureau of Cooperative Research, University of 
Minnesota, Minneapolis, Minnesota. (Eel 301.) 

S. Jones' Visual Vocabulary Tests. Selecting ten of the most 
widely used primers, Jones found the frequency of occurrence in 
all the primers of each word occurring in any of them. He used 
this frequency as a measure of the value of each word. Using the 
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values thus determined for eacli word, lists of words were made up 
as tests. The score is tlie sum. of tiie values attached to the words 
which the pupil can pronounce correctly. Address K. GL Jones, 
Cleveland, Ohio. (Ref. 308.) 

4. Price's Oral Reading Tests. These consist of a series of 
suitable oral reading exercises for Grades II to VIII, inclusive. Two 
forms are available for each grade. Pupils are scored for words 
mispronounced, words inserted, words omitted, words transposed 
and number of words read. Address Supt. E. D. Price, Enid, 
Oklahoma. 

XI. Spelling 

1. Ayres* Spelling Scale. This scale consists of a list of the 
one thousand most frequently used words of the English language. 
These were determined by means of careful analysis of written 
material, ranging from friendship letters to some of our best prose. 
Later the words weje classified according to frequency of mis- 
spelling for each of the several grades, and the percent of correct 
spellings for each grade was printed at the head of each list. These 
standards are for the words when used in dictated lists and without 
regard to whether the words have been taught in the respective 
grades or not. 

Strictly speaking, Ayres' Spelling Scale is not a scale or test, 
but a list of words from which tests can be made to measure the 
ability of pupils to spell the foundation words of the English lan- 
guage. The next four tests were constructed by using words from 
Ayres' list. Address Russell Sage Foundation, New York City. 
(Ref. 352.) 

2. Courtis Standard Research Tests in Spelling. In these 
tests words chosen from suitable columns of Ayres ? Scale are em- 
bedded in sentences, and the sentences are arranged so that they 
can be dictated at specified rates, which correspond to the rate of 
writing in the several grades. Each test includes 20 words. The 
standards set by Courtis are slightly lower than Ayres* Standards 
for the same words when dictated as isolated words. Address 
S. A. Courtis, 82 Eliot St., Detroit, Michigan. 

3. The Iowa Dictation Exercise and Spelling Tests. These 
tests, prepared by E. J. Ashbaugh, of the Extension Division, Uni- 
versity of Iowa, consist of twenty words embedded in sentences and 



gg TEE SEVENTEENTH 

an equal number to be dictated separately. Each of the sentences 
has been constructed so that It is to be written in 30 seconds. Test I 
Is for Grades III and IV, Test II is for Grades V and VI and 
Test III is for Grades VII and VIII. Address E. J. Ashbaugk, 
Iowa City, Iowa. 

4. The Nebraska Spelling Test. This test, prepared by Dean 
Chas. Fordyee, of the University of Nebraska, consists of twenty 
words embedded in sentences which are to be dictated at rates speci- 
fied for the several grades. The same words are used for all grades. 
Address Dean Chas. Fordyee, Lincoln, Nebraska. 

5. Honroe's Timed Sentence Spelling Tests. These tests dif- 
fer from the foregoing in that 50 words are used and no test words 
occur at the end of a sentence. This last feature protects the slow 
writer. Test I is for Grades III and IV, Test II is for Grades V 
and VI and Test III is for Grades VII and VIII and for the high 
school. The normal rate of writing was determined by measuring 
the speed of 6,000 Kansas school children. Address Bureau of 
Educational Measurements and Standards, Emporia, Kansas. 

6. Boston Minimum Spelling Lists. These consist of a list 
(for each grade) of " commonly used but often misspelled words." 
These words have been standardized for the grades in which they 
are to be taught, and hence constitute lists from which words for 
testing may be selected. Address Department of Educational In- 
vestigation and Measurement, Boston, Mass. (Eef. 355.) 

7. Buckingham's Spelling Scale. Starting with a list of 
about 5,000 words common to at least two out of five spelling books, 
Buckingham by means of an elaborate statistical procedure, selected 
two lists of 25 words each. The purpose of the selection was to 
secure " words which, were easy enough in the third grade and hard 
enough in the eighth, grade to afford a test in those and therefore 
intermediate grades, and which showed regular increases in percent 
correct from grade to grade." The difficulty of each word was de- 
termined in terms of a common unit. Since the difficulty of each 
word is known, the entire list, or any desired portion of it, may be 
used as a test. Address Bureau of Publications, Teachers College, 
Columbia, University, New York City. (Eef. 358.) 
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8. Jones 9 Concrete Investigation of the Material of EnglisJi 
Spelling. TMs bulletin presents the results of an investigation to 
determine "what words, 'grade for grade/ do cMldren use in their 
own free written speech, and which, therefore, they need to know 
how to spell. * * This list has been used as the basis for the construc- 
tion of tests. One such test has been devised by W. W. Phelan, 
University of OHahoma, Norman, OHa., and used extensively in 
that state. For the* Bulletin, address University of South Dakota, 
Aberdeen, South Dakota. (Eel 370.) 

9. National Business Ability Tests. The elementary test con- 
sists of 50 words chosen from Ayres* list of 542 obtained from the 
examination of two thousand letters. The advanced spelling test 
consists of a list of 50 words which are printed incorrectly. In 
ten minutes the pupil is to write the words correctly. Address 
Sherwin Cody, 189 West Madison St., Chicago, Illinois. 

10. Rice's Spelling Test. TMs test has a very great historical 
importance because it was Bice's report on spelling at the meeting 
of the Department of Superintendence in 1897 that marks the begin- 
ning of the modern movement for scientific measurement in edu- 
cation. (Bel 378.) 

11. Starch's Spelling Scales. These scales have a function 
which differs from that of Ayres 3 Scale or a test made from Ayres* 
list. The latter measures how well pupils can spell the most com- 
monly used words of the English language, while Starch's test 
measures the size of one's spelling vocabulary. The tests consist 
of words selected at random, from the non-technical words of the 
English language, with no regard to the frequency with which they 
are used. Address Daniel Starch, University of Wisconsin, Mad- 
ison, Wisconsin. 

Standards: Starch gives the following standards for Ms tests 
based on their use with over 2,500 pupils. 



Grade 


I 


n 


m 


rv | v 


vi | vn | vm 


Percent of words 
spelled correctly ..... 


10 


30 


40 


51 1 61 


71 1 78 1 85 



These standards are interpreted thus : the average eighth-grade 
pupil should be able to spell correctly 85 percent of the non-tech- 
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ideal words of the English language, or 85 of the 100 words in any 
one of Starch's tests. (Eel 384.) 

TESTS FOE USE IN THE HIGH SCHOOL 

Certain tests of those described in the preceding pages are in- 
tended to be used in the Mgh school, as well as in the elementary 
school. These are Test III of the Kansas Silent Reading Tests, the 
Thomdike Scale Alpha for Measuring the Understanding of Sen- 
tences, Starch's English Vocabulary Test, certain composition 
scales, the copying test, the Trabne Completion-Test Language 
Scales, and Starch's Grammatical Tests. For the description of 
these tests and the use of them, the reader is referred to the pre- 
ceding pages. 

In addition to these tests, many of the others have been applied 
to high-school pupils. For example, the Courtis Standard Research 
Tests in Arithmetic, Series B, have frequently been given to high- 
school pupils, although many of them were not studying arithmetic. 
However, in applying such tests to high-school pupils it should be 
remembered that the tests were not designed for that purpose, and 
it may be expected that they will not be as satisfactory as when used 
in the way intended. 

I. Algebra 

1. Coleman's Scale for Testing Ability in Algebra. This test 
consists of a series of exercises arranged in order of difficulty. Ad- 
dress Supt. W. H. Coleman, Bertrand, Nebraska. 

2. Hotze's First-Tear Algebra Scales. These scales include 
tests on the following topics: (1) addition and subtraction, (2) 
multiplication and division, (3) equations and formulas, (4) graphs, 
(5) problems. They were restricted to these topics because the 
author felt " that the main business of the work in first-year algebra 
was to teach students how to solve typical algebra problems through 
the use of algebraic symbols.' 5 Address Bureau of Publications, 
Teachers College, Columbia University, New York City. 

3. Indian Algebra Tests. Monroe's Standard Research 
Tests in Algebra, described below, were incorporated in this series. 
The other six tests of the series were devised by H. G. Childs, of the 
University of Indiana. (Ref. 58.) 
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4. Monroe's Standard Research Tests in Algebra. These con- 
sist of a series of six tests. Each of the first five tests is designed 
to measure tlie ability to do one of tlie operations occurring in the 
solution of simple equations. Address Bureau of Educational 
Measurements and Standards, Kansas State Normal School, Em- 
poria, Kansas. (Eefs. 60, 61.) 

STANDARDS: MEDIAN SCORES TOR MONROE'S STANDARD RESEARCH TESTS rsr ALGEBRA 



Number of pupils 


2077 


1993 


2107 


| X V 

2127 


2198 


| V A 

1992 


Speed, number of ex- 














amples attempted 


14.6 


5.4 


11.5 


10.2 


11.2 


8.3 


Accuracy, percent of ex- 














amples correct 


96 


41 


100 


94 


77 


32 



o. Stromquist's Preliminary Algebra Tests. TMs series of 
tests includes tests upon the following operations: (1) addition, 
(2) subtraction, (3) multiplication, (4) division and (5) factoring. 
Address, University of Wyoming, Laramie, Wyoming. 

6. Rugg and Clark Standardized Tests in First-Year Algebra. 
TMs series includes sixteen tests which are intended to measure all 
of the types of exercises in the work of the first year. Address H. 
0. Eugg, University of Chicago, Chicago, 111. (Bef. 66.) 

TENTATIVE STANDARDS FOE EUGG & CLARK FIEST-TEAE ALGEBRA TESTS 

(Approximate Median Number of Problems Attempted per Minute 
for Each. Test) 



Test 


! 2 


5 


6 


7 


8 I 


10 


11 


12 1 


13 { 


14 1 


15 




. | 4.2 


14.5 


6.3 


i 13.4 


4.6 1 


3.0 


4.2 


3.5 1 


1-1 1 


7.31 


1.4 


Average of upper third 
of 27 schools 


-! 3.5 


11.6 


5.8 


12.5 


! 


1.5 


3.2 


2.91 


i-ol 


5.8f 


2.5 


Ninth school 


.| 3.2 


10.7 


5.5 


11.5 


3.9| 


1.2 


2.8 


2.6J 


0.81 


5.2] 


3.9 


Average of 27 schools . . . 


.| 3.0 


10.4 


4.9 


11.2 


8.61 


1.1 


2.7 


2.4J 


0.8[ 


4.91 


3.1 


Poorest school 


.| 2.2 


6.5 


2.8 


7.9 


2.41 


0.5 


1.5 


1.41 


0.5| 


2.91 





(Approximate Median Number of Problems Bight.) 



Most efficient school . 



3.2[ 13.2 



5.4| 11.81 



2.81 2.81 0-9| 5.3 1 2.0 



Average of upper third 
of 27 schools 


2.7 


11.0 


4.8 


10.7 


3.5 


0.8 


1.6 1 2.0 


0.7 


3.9 


4.2 


Ninth school 


3.2 


10.0 


4.4 


9.0 


2.9 


0.5 


1.2| 1.7 


0.6 


3.4 


5.9 



Average of 27 schools . . 
Poorest school 



2.2 j 9.71 8.81 9.2| 2.9| 0.5 1 1.1 1 1.4| 0.6| 2.8 j 7.9 
1.2 1 6.1| 2.2| 4.8 1 1.7J 0.21 O.lj 0.5J 0.31 O.lj 



(Standards for Tests 1, 3, 4, 9 and 16 will be sent to cooperating schools 
during 1917. 

Score for Test 15 is minutes required to solve one problem. 
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7. Tfiomdike's Algebra Test. This Is a series of eight exer- 
cises arranged in order of increasing difficulty as determined by tlie 

opinion of competent judges. 

II. Drawing 

1. Eugg's Scale for Measuring Freeltand Lettering for Use in 
Secondary Schools and Colleges. It consists of a series of 8 samples 
of freehand lettering, arranged in the order of increasing merit. 
It may be used in measuring the efficiency of a student's work in 
freehand lettering. Address H. 0. Kugg, School of Education, 
University of Chicago, Chicago, HL (Bel 156.) 

III. Foreign Language 

1. Brown's Connected-Latin Test. This test consists of a con- 
nected passage of Latin, to be interpreted in terms of its thought 
content. The pupils are given a specified amount of time in which 
to interpret and write in English as much of the passage as pos- 
sible. The translation is scored by means of a key. 

2. Brown's Latin-Sentence Test. This consists of a series of 
Latin sentences ranging from very easy to very difficult. The sen- 
tences are graded and evaluated, and each is assigned a scale value. 

3. Brown's Formal Latin-Vocabulary Test. A list of fifty 
isolated words which have been graded and evaluated and a scale 
value assigned to each. The pupils are scored on their ability to 
give correct meanings for the words. 

4. Brown's Functional Latin-Vocabulary Test. A list of 
words in the Latin-Sentence Test. The pupils are scored on their 
ability to re-act to these words correctly in their functional rela- 
tionships in sentences. 

5. Brown's Formal Latin-Grammar Test. This test is made 
up of twenty constructions in Latin sentences. The constructions 
are in italics and the pupils are required to name and describe them, 
but not to translate the sentences. 

6. Brown's Functional Latin-Grammar Test. A series of 
Latin constructions chosen from the Latin-Sentence .Test. The 
pupils are graded on their ability to react correctly to these con- 
structions in their normal settings. 
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With, the foregoing six tests a survey was made of the work in 
Latin in New HampsMre secondary schools. The high schools of 
every city and every large town in the state were tested. Most of 
the private academies and seminaries were also reached. The re- 
sults are to be set forth, in a document entitled A Study of Ability 
in Latin. This will consist of about 300 pages when printed and 
will be published by the Bureau of Educational Research of the New 
Hampshire Department of Public Instruction, Concord. For fur- 
ther information address President H. A. Brown, State Normal 
School, Oshkosh, Wisconsin. (Ref. 277.) 

7. Hanus* Latin Tests. These consist of four tests for vocab- 
ulary, a translation test, and a grammar test. All of these tests 
are based on Caesar and Cicero. No words appear in the vocabu- 
lary tests " which occur less than one hundred times in Caesar and 
Cicero." The translation test "contains only constructions which 
are found at least five hundred times in Caesar and Cicero." The 
grammar test is based on the sentences to be translated. Address 
Paul Hanus, Harvard University, Cambridge, Massachusetts, (Ref. 
278.) 

8. ffenmon's Latin Tests. These consist of (1) an easy hun- 
dred-word vocabulary test 50 in English and 50 in Latin con- 
taining the words that are common to four widely used first-year 
books, (2) a standard vocabulary test of 239 words representing all 
the words common to 13 first-year books and to Caesar, Cicero, and 
Virgil, (3) a Latin-sentence test consisting of 30 sentences con- 
structed by using none but the 239 words of the Standard Vocabu- 
lary Test. Address V. A. C. Hennon, University of Wisconsin, 
Madison, Wis. 

9. Starch's French, "Vocabulary and Reading Tests. The vo- 
cabulary test consists of 100 French words selected at random from 
a French dictionary. The English equivalents of these words are 
given on the test sheet, and the pupil is tested by means of the num- 
ber of English equivalents he can correctly associate with the 
French words. The reading test consists of simple sentences to 
be translated. 

10. Starch's German Vocabulary and Reading Tests. These 
are similar to the tests for French. Copies of these tests may be ob- 
tained from Daniel Starch, University of Wisconsin, Madison, Wis- 
consin. 
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11. WJiipple's German Vocabulary Test. This is a vocabu- 
lary test to measure the ability of graduate students to read scien- 
tific German in the field of educational psychology. A score of 60 
has seemed to indicate sufficient ability to read psychology and edu- 
cation in German. Address Guy M. WMpple, University of Illi- 
nois, Urbana, Illinois. 

IV. Geometry 

1. MinnicJc's Geometry Tests. This series of tests is based on 
the assumption that the demonstration of a geometrical theorem 
involves the following abilities : (1) the ability to draw the figure, 
(2) the ability to state the hypothesis and conclusion, (3) the ability 
to recall facts concerning the figure, (4) the ability to select and 
organize facts so as to produce the proof. Address J. H. Minnick, 
University of Pennsylvania, Philadelphia, Pennsylvania. 

2. Rogers' Mathematical Tests. These are a series of tests 
designed to measure several types of reasoning ability in the field 
of mathematics. The series includes tests on arithmetic and alge- 
bra as well as geometry. Address Bureau of Publications, Teachers 
College, Columbia University, New York City. 

3. Stockard and Bell's Geometry Test. This test consists of 
70 questions arranged in 20 groups. "These groups involve draw- 
ing figures, naming figures, indicating order of development in dem- 
onstration, completing statements, stating of converse, definitions, 
regular polygons, parts of a demonstration, angular relations, area 
of trapezoid, angles in polygons, angles in circles, congruency of 
triangles, similarity of triangles, loci, auxiliary lines, simple con- 
structions, ratio and proportion, algebraic expression of geometrical 
relations, and equivalent construction. The questions are asked in 
such a way that many pupils are able to complete the list in forty 
minutes." (Kef. 223.) 

V. History 

1. Sackett's Scale in Ancient History. This scale consists 
of a series of eight tests, or exercises, the questions of which, call for 
the essential information in the field of ancient history. The items 
of this information were determined upon the basis of a careful 
examination of an American history text and the judgment of 
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experts in the field. Address L. W. Saekett, University of Texas, 
Austin, Texas. (Eel 273.) 

VI. Physical Training 

1. Rapeer's Scale for Measuring Physical Education. TMs 
is a score card for Judging five aspects of the results of physical 
education, i.e., health, physiological efficiency, physical develop- 
ment, physical ability and mental qualities. Address L. W. Eapeer, 
San Juan, Porto Eieo. 

VII. Physics 

1. Star cli y s Tests in Physics. The tests consist of 75 sentences 
from which certain words have been omitted. The sentences and 
the words to be omitted have been so chosen that a* pupil cannot 
supply the s correct words unless he knows certain physical facts or 
principles. The facts, principles, and laws upon which these sen- 
tences are based were determined by examining five widely used 
textbooks. The 102 facts, principles, or laws which were treated by 
all five of the books are the ones which the pupils must know to do 
the tests correctly. Address Daniel Starch, University of Wiscon- 
sin, Madison, Wisconsin. 

DISTRIBUTING CENTERS 

Information in regard to particular tests can always be ob- 
tained by writing directly to the authors. Very many of the tests 
and scales, however, can also be secured from various distributing 
centers, principally University Bureaus of Cooperative Eesearch. 
For the convenience of those interested, the addresses of the six 
most important distributing agencies are given below : 

1. Bureau of Publications, Teachers College, Columbia Uni- 

versity, New York City. 

Tests by Thorndike, Stone, Hillegas, Trabue, Woody, 
Bonser and many others. 

2. Eussell Sage Foundation, Division of Education, New 

York City. 
Ayres Writing and Spelling Scales. 



104 THS BMVSNTEMNTH TSASSOOK 

B. S. A. Courtis, 82 Eliot Street, Detroit, Michigan. 

Besearch Tests in Arithmetic (Series A and B), Beading 
(Series R), Writing, (Series W), Spelling, (Series S). 

4. School of Education, University of CMcago, Chicago, Illi- 

nois. 

Gray's Beading Tests, Cleveland Arithmetic Tests, Bugg's 
Algebra Tests. 

5. University Supply Association, Madison, Wisconsin. 
Tests by Starch and Henmon. 

6. Bureau of Educational Tests and Standards, Kansas State 

Normal School, Emporia, Kansas. 
Tests by Monroe, Kansas Silent Beading Tests. 

7. Bureau of Cooperative Besearch, University of Minnesota, 

Minneapolis, Minnesota. Tests by Haggerty. 

Very often schoolmen who undertake measurement work with- 
out previous training meet difficulties in the scoring and tabulating 
of the results, or in interpreting them, which they are unable to 
overcome without assistance. Ordinarily, this assistance can be 
had for the asking from any worker in the field, but particularly 
from Departments of Education in State Universities. A letter, or 
better a personal visit, will often not only clear up in a few minutes 
a misunderstanding that otherwise might have led to failure and 
discouragement, but also bring into mutually helpful relations the 
so-called theoretical and practical educational forces of the state. 
The supreme service of educational testing is that it reveals prob- 
lems, stimulates attempts at solution, and affords measures of the 
success of the efforts made, but even the simplest educational prob- 
lems are so important, so complex, that they demand the united co- 
operative efforts' of educational workers of every type. 



CHAPTER VIH 

BELATED FORMS OF EDUCATIONAL INVESTiaATION 



W. A. AVEBILrL 
State Education Department, Albany, "N. T. 



The broadest interpretation of the title of this chapter includes 
everything in the whole school world which remains over and above 
the measurements of classroom work discussed in the other chapters 
of this Yearbook. It would call for the consideration of a formid- 
able array of topics of all sorts from the dust content of school- 
room air to the nature and results of educational legislation & 
range quite beyond the possibilities of this part of the Yearbook. 
Accordingly, the aim of this chapter will be two-fold; (1) to call 
the attention of superintendents to the different types of investiga- 
tions being made, and (2) where investigations are of a conven- 
tional type, as cost accounting, study of enrolment, etc., to indicate 
present tendencies, rather than to give a detailed statement of the 
entire field. 

Content of fhe Course of Study. Possibly the most significant 
type of investigation, as well as one immediately related to class- 
room measurement, is the analysis of the curriculum, both in ele- 
mentary and high schools, with special reference to the content of 
the courses of study and to the relative amount of time devoted to 
the different subjects. Ayres* investigations in spelling have 
pointed the way to the elimination of waste in accomplishing given 
results and have shown which words among the thousands taught 
were proper tasks for the children of the various grades. Similarly, 
the investigations of Bagley and Bugg in history, 1 Jessup in arith- 
metic, and others of the same type have served to indicate the meth- 
ods by which a scientific curriculum may eventually be constructed. 

Pupils' Marks and Scholarship Ratings. Another type of in- 
vestigation most intimately related to classroom measurement is the 
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study of the marks given pupils by teachers. Two growing tenden- 
cies are worthy of mention. ; first, superintendents are recording and 
studying the marks received by a class In order to discover wliat 
percentage of the pupils receive superior, satisfactory and poor 
ratings, and they are rating teachers, and making adjustments of 
work, on tie basis of comparative percentages of failure ; second, 
they are accumulating such data from year to year and subjecting 
them to careful statistical and graphical analysis. That is, school 
men are no longer content to hope and "believe that their work Is 
going well; they are attempting systematically to secure exact 
knowledge of the effects of their efforts by a scientific study of all 
available data. 

Rating tJie Teacher's Efficiency. Immediately related to the 
measurement of the work of the pupils is the estimate of the teach- 
er ? s ability. The tendency appears to get away from general com- 
ment and to record specific details about the recitation itself. A 
rating card of the general type contains such questions as : 

Does the teacher show skill in habit formation ? 
Does the teacher show skill In stimulating thought? 
Is the; subject matter organized? 

Are proper habits of action developed both in and out of the 
classroom! 

Is the teacher Interested in the life of the community? 

A rating card which goes into particulars contains such ques- 
tions as : 

Number of minutes lost in calling the class ? 

Number of minutes lost in distributing material? 

Extent to which the recitation was confined to the text? Re* 
lated to the pupils' lives and experiences? 

Number of questions which caused the pupils to think before 
answering? Number requiring merely yes-or-no answers? 

Another tendency of teacher rating takes the form of self -exam- 
ination, of which the following is an illustration : 

Clearing up pupils' difficulties. 

1. What plan or method have I for discovering the difficulties 
which the class as a whole may have, and specific difficulties which 
individuals may have? For providing the particular help a pupil 
needs to clear up Ms own difficulty? 
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2. When a large enrolment makes it practically impossible to 
provide the special help needed by individuals, what is my method 
of providing it ? 

3. Do I appreciate that a pupil may lose a half year or a full 
year as the result of my failure to give him just the help he needs 
at the time he most needs it ? 

4. Am I inclined to shift the responsibility for pupils' failure 
to causes outside myself f 

5. What evidence have I that I am successful in clearing up 
pupils' difficulties? 

Still another important type of investigation connected with 
the rating of teachers, and one which is rapidly growing in favor, is 
the study of stenographic reports of actual recitations. 

Promotions and Non-Promotions. The question as to the num- 
ber of pupils promoted at the close of the term arises naturally 
after mention of the teacher's efficiency. In the limited space of 
this chapter it is enough to call attention to the fact that superin- 
tendents are finding it desirable to record separately the following 
types of promotion: 

1. The mid-term promotion, where the pupil has spent about 
half the regular time in each of two grades. 

2. The double promotion, in which the pupil is made to skip 
an entire grade. 

3. The straight, earned promotion to the next higher grade. 

4. The un-earned promotion, meaning that the pupil has not 
fi passed," but has been in one grade so many terms that there is 
no longer any benefit in keeping him there. 

5. The conditional or trial promotion. 

6. The failure, or non-promotion. 

7. The demotion to a lower grade. 

In comparisons of different cities, investigators should have 
these distinctions in mind, otherwise they may not be comparing 
the same things. In other words, the tendency in this field, also, 
is to define more sharply the analysis that is made. 

Teachers' Reasons for Pupils' Failures. The causes of non- 
promotion are a well-known subject of investigation and report, but 
often the investigation is limited to asking the teachers to write 
opposite the name of each non-promoted pupil a reason for the fail- 
ure. Under these conditions teachers will usually ascribe about 40 
percent of the failures to the pupils' mentality and 20 percent to 
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the pupils" lack of application. Here, too, the tendency is to push 
the analysis further and demand reasons based upon objective 
evidence. 

Elimination. Closely associated with the examination of fig- 
ures relating to promotions, is the consideration of the extent to 
which pupils have dropped out of school before promotion time. 
In the past it has been customary not to count as non-promoted any 
pupils who have dropped out before examination. This improves 
the showing, but in line with modern tendencies it is proving more 
valuable in getting at actual school facts to keep a record of the 
following types of withdrawal and to give them their full weight in 
any use wMch is made of promotion figures. 

1. Transfer to another part of the same public-school system. 

2. Transf er to schools without the local system. 

3. Eemoval from city with an implied continuance of 
schooling. 

4. Schooling stopped for the current term: 

a. Poor health. 

b. Bona fide cases of ' ' needed at home > ' 

c. Actual poverty. 

5. School given up as a bad job : 

d. Incapacity 

e. Indifference 

f. Disciplinary. 

Vocational Education. Early investigations of the causes of 
withdrawal from school, particularly those which recorded the state- 
ments of pupils and parents, as in the Minneapolis survey, brought 
out the fact that neither pupils nor parents regarded schooling be- 
yond the grades as of very material aid in gaining a livelihood. A 
few studies were made, correlating wages and salaries with time 
spent in school. Then the rapid growth of manual training, shop 
courses, and definite training for the industries, supplied material 
for a whole literature of vocational investigation and survey. This 
soon passed beyond the content of the curriculum to the industries 
themselves, culminating in the thoroughgoing survey of the Cleve- 
land type, in which the whole city is analyzed vocationally and the 
data, quantitative as well as qualitative, are practically and con- 
structively related to the schools and their program. It is interest- 
ing to note that in this connection, the first chapter of the Bloom- 
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ington, Indiana, survey report treats of the occupations of the 
women and the men employed in the city. 

Ages of Pupils and Progress Through School. It would be 
presumptions to re-state the principles of age and progress research 
so clearly outlined by Dr. Leonard P. Ayres in Ms Laggards in our 
ScJwols and TJie Identification of the Misfit CMLd. The nine cate- 
gories of pupils that result from the possible combinations of three 
age and three progress factors are appearing year by year in a 
larger number of superintendents' reports. The tendency to get 
away from a liberal margin of " years of normal age 75 which would 
enable any city to have a comfortable preponderance of " normal " 
pupils is in keeping with the demands of modern supervision and 
research. "To obtain for one city a record which will exceed the 
record of other cities 77 may serve the purpose of self -congratulation, 
but the more nearly correct picture of the situation which is ob- 
tained by using a single year age-limit for each half-grade (as is 
now done in New York State) is far more valuable, if less flattering, 
to the local superintendent. Present practice figures age at the 
time of beginning a given grade or completing it, rather than "be- 
ing in a grade" sometime during the school year, and the prefer- 
ence is for the time of beginning. The actual statistics may be 
gathered any time during the early autumn. Bachman advances 
good reasons for figuring ages on August 31, the beginning of the 
official school year; the superintendents of New York State have 
chosen September 15 for the age date. The investigations of age, 
progress, elimination and retardation have become far too numerous 
to list separately in a chapter of this length. A new type of investi- 
gation is, however, to be seen in the occasional attention given in 
these studies to the exceptionally capable pupils who have been al- 
most forgotten in our efforts in behalf of their more unfortunate 
classmates. 

Cities and Villages Studied in Groups. For the investigation 
of enrolment by grade, elimination, age and progress through school, 
the New York State Education Department has divided the cities, 
villages and union high schools with elementary departments into 
groups based on the elementary enrolment. By means of mechan- 
ical tabulation, the data supplied by several hundred communities 
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throughout the state are quickly tabulated, analyzed, and returned 
to the systems which contributed the Information. Beturns will 
be made* it is believed,, in time to be of use to the superintendents 
early in the next school term. Beginnings in this form of educa- 
tional accounting' have been made in the principal cities of the 
state and in 12 cities with an elementary enrolment 3,000 to 5,000 ; 
26 with 1,000 to 3,000 ; 44 viUages with 500 to 1 3 000 ; 58 with 300 to 
500 ; 227 enrolling 100 to 300 elementary pupils and about 100 union 
schools with fewer than 100 elementary pupils. The superintendents 
of these school systems will be glad to exchange data with systems 
of like size throughout the country. 2 

Superintendents willingly receive comparisons of their systems 
with others of like size similarly situated. The first reaction toward 
this matter is an attempt to explain away the retardation and other 
defects; it is only afterwards that the problem of doing away with 
it is attacked. Seducing the figures to common denominators of 
ske 3 wealth, foreign elements and shifting population wins the con- 
fidence and cooperation of superintendents and principals and 
paves the way for constructive work. The mechanical tabulation of 
the returns also makes possible the correlation of progress-through- 
seiool with such factors as teachers' salaries, principals' salaries, 
number of pupils per teacher, per capita assessed valuation of the 
school district, number of hours devoted daily to supervision by the 
principal, and in small schools, the number of grades taught by one 
teacher. 

Investigations Giving Rise to Permanent Eecords. It is of in- 
terest to follow the usual course of many investigations of the type 
mentioned thus far in this chapter. Often the first stimulus to ac- 
tion is a questionnaire received by the superintendent; next a sur- 
vey of classroom work is made with standard tests ; then an age- 
progress survey follows, and the superintendent begins to incorpor- 
ate into Ms report some of the outcomes. Soon the giving of stand- 
ard tests and the statistical study of school records become a part 
of his regular work. Finally the items of information necessary 
for these investigations become the subjects of permanent record in 
the superintendent's office and appear regularly in his report. 

3 Addiess W. A. AveriU, State Education Bldg., Albany, 1ST. Y. 
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Groups of Belated Investigations. There should be mentioned 
liere quite an array of investigations, largely correlated with, re- 
tardation, progress and tlie achievements of pupils as measured by 
standard classroom tests, which for want of space can only be listed. 

Studies having to do with 

1. Physical conditions of the children in school (hearing, 
eyesight, development, etc., medical inspection, school lunches, heat- 
ing, ventilation, school furniture, etc.). 

2. Home conditions (sleep, breakfast, play, home study, out- 
side work, etc.). 

3. Special classes (blind, deaf, mentally defective, tubercular, 
super-normal, special promotion plans, coaching rooms, supervised 
study, etc.). 

4. School organization (school programs, recesses, fatigue, 
vacations, division of school year, kindergarten, junior high 
schools) - 

5. Compulsory attendance (delinquency, discipline, truancy). 

6. Social and moral welfare. 

Organization of City School Systems. Different in type though 
related are investigations dealing with the organization and 
ad-ministration of city school systems, as represented by the work 
of Cubberley, Strayer, Thorndike and others. Attention is centered 
on the functions of the different officers of the system, and the 
chief purpose is perhaps to determine the proper alignment of 
the functions of the school board and the superintendent. The 
conception of a school organization in which the superintendent 
supervises the educational work and a coordinate business officer 
manages the finances and school plant, is being abandoned in fa- 
vor of an organization in which the superintendent, as the chief 
executive officer of the board, is, next to the board itself, the head of 
the entire system, and the one to whom all other officers, both busi- 
ness and educational, are subordinate. Investigations in educa- 
tional legislation show this same trend. Legislation recently passed 
in New York State gives every city a school organization on the 
plan just mentioned. 

School Buildings. An important series of investigations is 
that dealing with the subject of school buildings. The surveys 
made in Cleveland, Oakland and Milwaukee are typical. The 
grouping of types of school architecture by decades, as in the 
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Cleveland survey, is a significant modem tendency. Sanitation 
and hygiene naturally play a large part in these studies, as do 
ventilation, illumination and safety from fire. Belated to tMs 
group are occasional investigations of janitor service. 

and Social Service. Much has also been said and 
written about the wider use of school buildings their use at 
night and in vacations, school-board policies with reference to 
permitting various organizations to use school buildings and 
charging for their use. These surveys, however, lead into the 
field of community welfare and belong rather to the adult world. 

The Cost of Educational Work. Finally, no investigation of 
educational conditions or work can be considered complete which 
does not show the cost of obtaining the results achieved. The ear- 
lier investigations of cost were largely devoted to teachers' salar- 
ies; indeed, for many years salaries and "other expenses " were 
about all that could be culled from school accounts. Now, invest!* 
gations of school cost fall into three categories: (1) those dealing 
with the classification of payments for school purposes, (2) those 
treating of the accounting procedure which gives the desired 
classification and (3) studies of comparative cost by items, schools 
and cities. 

The present tendencies may be stated as follows : 

The school budget is designed according to function, or ^ the 
kind of work done or service rendered. The four main functions 
are (1) regulative and executive service, (2) property (acquisi- 
tion, construction, equipment, maintenance, and operation), (3) 
instructional, or supervision and teaching, and (4) extension and 
social service. 

School moneys are appropriated by main functions only, all 
details of expenditure are left to the board of education. 

The classification of expenditure involves four things about 
every payment made, namely, (1) the function subserved, (2) 
the character of the payment as a fiscal transaction, (3) the de- 
tailed object of the expenditure and (4) the location in the sys- 
tem to which it is chargeable. 

The accounting procedure itself has been simplified by aban- 
doning large unwieldy forms in favor of smaller loose-leaf sheets ; 
by using flexible code symbols at the top of columns; by using 
voucher-checks and warrants in place of the old forms of voucher 
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jacket ; and by the standardization of the size of all blanks and 
cards to the new dimensions used commercially. 

Accounts have been rendered more valuable by including a 
register of orders, a register of accounts payable and an appropri- 
ation ledger showing at any time the unencumbered balance as 
well as the unexpended balance. 

Finally the information obtained is reduced to proper units 
for comparative analysis per capita units, for instructional func- 
tions and square and cubic foot units for building, maintenance 
and operation functions. Graphic presentation is employed where 
ever possible. 

Modern Office MetJwds and Equipment. As a subject for pres- 
ent and future investigation, mention should be made of the equip- 
ment of superintendents' and school board offices and "modern bus- 
iness methods" of handling clerical work and routine. The ad- 
ding machine, the calculating machine and the slide-rule will en- 
able one or two clerks to perform a surprising amount of statis- 
tical work. The T-square and ruling pen are easily mastered 
tools for graphic presentation. Time for research is often to be 
gained by a reorganization of office routine and the elimination of 
unnecessary records and procedures. Finally, larger systems can 
solve many of these problems by resorting to the mechanical tab- 
ulation of statistics, both educational and financial. 

Conclusion. The breadth of the field presented by educational 
investigations as a whole has made their mention in this chapter 
disconnected and their discussion, when possible at all, so brief 
as to be perhaps inadequate. After all, we must revert to the sub- 
ject of the other chapters of this Yearbook the measurement of 
the educational work itself as that which is most important, be- 
cause it is most closely related to the purpose of the schools, the 
education of the children who attend them. Other types of in- 
vestigation should serve to throw all possible light on the local 
system in which given educational results appear. They should 
be of aid in effecting that interpretation of classroom work which 
will make for fair criticism and constructive suggestion. In fine, 
these related forms of educational investigation stand as an in- 
terpretative background to the more special measurements that 
mark the achievements of pupils in the schools. 
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STATISTICAL TEEMS AND METHODS 
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As educational reports multiply, It becomes increasingly evi- 
dent that there is undesirable variation in both their method and 
language. A standard procedure and terminology will be helpful, 
both to makers and to readers of reports. Moreover, the applica- 
tion to education of statistical methods developed in other fields 
needs to be made clear. It is the purpose of this paper to state 
what appears to be the best practice and to note the assumptions 
on which the practice is based. 

In certain sciences a higher degree of accuracy is required 
than is possible with a single measurement. Accordingly, many 
measurements are made of the same magnitude, and their average 
taken as the true amount. It was early ascertained that these 
measures showed a certain definite arrangement, in accordance 
with which values at or near the average of all the measures were 
of greatest frequence, and measures which differed from the av- 
erage were less frequent the greater their difference from it. Fur- 
ther, it was found that the number of measures greater than the 
average was likely to be equal to the number less than the av- 
erage by the same amount. The graphical representation of this 
kind of a series took the form which we have lately become famil- 
iar with as the 'normal' or "probability 7 surface (see Figure 2). 
Measures which differed from the average were thought of as 
being in error, and this lead to the development of what has been 
called the "theory of error" a theory involving the symmetrical 
arrangement of measures of the same thing about the true meas- 
ure as represented by their average. 

The assumption was next made that there was an analogy 
between a series of measurements of the same thing, and a series 
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of single measurements of each of a number of individuals alike 
in some important characteristics. This analogy was found to 
work out very well for biological data. Economical data, on the 
other hand, do not appear to afford the same analogy, and since, 
prior to the recent application of statistics to education these 
methods have been used mainly by biologists and economists, 
statisticians were divided into two schools the one adhering to 
the doctrine of the theory of error, the other rejecting it. The bi- 
ologists, broadly speaking, belong to the former and the econo- 
mists to the latter school. 

The evidence is strong that educational measurements tend 
to resemble those of biology in their structure, i. e., that the theory 
of error applies. Published results often fail to reveal this, but 
when such is the case, it is almost always due to scanty data, or 
to the selection of the children, or to the measuring instrument 
itself. 

It is to be understood that the validity of the statements in the 
succeeding pages of this chapter rests on the assumption that edu- 
cational measurements substantially conform to the arrangement 
wMeh exists among many measurements of the same thing, i. e., 
that they conform somewhat closely to the theory of error, and 
exhibit approximately 'normal distribution. 7 

A variable is a quantity which under the conditions imposed 
may assume different values throughout the discussion. In re- 
peated measurements of the same thing, the obtained measures 
differ through ' error.' In education, where we make numerous 
single measurements of different pupils grouped together on the 
basis of some common characteristic, each different value con- 
stitutes a value of the variable. The number of problems solved 
correctly by seventeen girls in an eighth-grade class was as fol- 
lows: 9, 3, 7, 8, 5, 6, 7, 6, 5, 7, 5, 6, 4, 8, 7, 4, 5. Bach different 
number in this series is a value of the variable "performance of 
upper eighth-grade girls in solving specified problems in arith- 
metic/' 

Attention must be given to the nature of the units in which 
the variable is expressed. They may indicate mid-points or lower 
limits, and they are influenced by the accuracy of the measurements 
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upon which they are based. 'In the Nassau County Supplement 
to the Hillegas scale, the samples have the following Tallies: 0, 
1.1, 1.9, 2.8. 3.8 7 etc. If a person reports to the nearest scale value, 
he is tising'eaeh value as a mid-point, and his rating of a compo- 
sition as 1.9 will mean that it is nearer to 1.9 than it is to 1.1 or to 
2.8 ; in other words, Ms 1.9 will mean from 1.5 to 2.35. If, how- 
ever, he rates a composition as 1.9 which has at least the merit of the 
scale sample at 1.9, but not as much merit as the sample at 2.8, 
he is using the scale-value as a lower limit, and his 1.9 will mean 
from 1.9 to 2.8, If he reports values between those given on the 
scale such that a composition slightly less meritorious than the one 
at 1.9 would be given a value of 1.8 or 1.7, and one slightly more 
meritorious than the one at 1.9 would be given a value of 2.0 or 2.1, 
then he is attempting to secure a greater degree of accuracy, and 
Ms 1.9 would mean 1.85 to 1.95. Thus, the same rating may have 
materially different meanings. It is necessary, therefore, that 
the units be accurately defined and that they be given the same 
meaning throughout a given discussion. 

A series in statistics is a grouping of the obtained measures 
of the variable by steps or classes. According to the nature of 
the data, series may be either discrete or continuous. A discrete 
series is composed of separate integers. If we record the number 
of children in each class in a school system, all of our measures 
will be of this nature. For example, between, classes of 20 children 
and classes of 21 children there can be no measures. A continuous 
series, on the other hand, is one which is capable of an indefinite 
degree of sub-division. The height of children, their weight, the 
time they take to do a given task, their general intelligence, their 
ability in specific ways, all of these when measured yield continu- 
ous series. We may represent the height of a child as 60 inches, or 
Ms mental age as 10 years. In these cases, however, our measures 
are only short-hand expressions for ranges whose mid-point is 
the measure as reported. Persons reported as 60 inches in height 
may be anywhere between 59.5 and 60.5 inches. Most measure- 
ments in education yield continuous series. Even when series, 
taken at their face value, are discrete, such as the numbers of prob- 
lems solved, they should be treated as continuous series, because 
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in the abilities which they are supposed to indicate, no gaps occur. 
To say that in a certain class six pupils got 10 examples right, 
only indicates that they had an ability which permitted them to 
work 10 examples correctly, but not 11. Their abilities might be 
more accurately represented, if we had material with which to 
do it, by 10, 10.27, 10.5, 10.84, etc. 

Measures when first received are unorganized, and no definite 
impression may be obtained unless their number is very small. 
The first procedure is to divide them into classes. For example, 
700 measures were obtained from eighth-grade boys who wrote 
Test No. 15 of a series of "Progressive Spelling Tests." The test 
consisted of 50 words. Clearly 700 measures in a hap-hazard ar- 
rangement convey almost no information as to how well these 
boys performed. We may classify the measures, as in Table I, by 
indicating the number of boys who spelled no words correctly, one 
word correctly, two words correctly, etc. This table consists of 
51 classes. 

TABLE I 

iosr oi 1 STH-GRADE BOYS ACCORDING TO THE NTTMBEB or WOBDS THEY 
SPELLED COBBECTLY "PBOGBESSIVE SPELLING TESTS/' No. 15 



No. of 
Words 
Correct 


No. of 
Pupils 


No. of 
Words 
Correct 


No. of 

Pupils 


! No. of 
Words 
Correct 


No. of 
Pupils 





7 


17 


15 


34 


22 


1 


14 


18 


20 


35 


15 


2 


9 


19 


19 


36 


16 


3 


6 


20 


18 


37 


12 


4 


11 


21 


25 


38 


20 


5 


13 


22 


20 


39 


13 


6 


18 


23 


20 


40 


11 


7 


11 


24 


14 


41 


14 


8 


11 


25 


15 


42 


7 


9 


13 


26 


20 


43 


9 


10 


9 


27 


23 


44 


5 


11 


13 


28 


22 


45 


2 


12 


8 


29 


22 


46 


3 


13 


17 


30 


25 


47 


4 


14 


12 


31 


19 


48 


2 


15 


19 


32 


24 


49 


1 


16 


14 


33 


18 


50 

1 





I 








Total 1 700 



Although Table I brings the measures into an orderly arrange- 
ment, it does not show the structure of the series as clearly as does 
Table II which is derived from it, and which exhibits but 10 classes. 
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TABLE H 
DSBIVKD IBOM TABLE I 



No. of 


No. of 


Words 


Pupils 


Correct , 




0- 5 


60 


6-10 


62 


11-15 


69 


16-20 


86 


21-25 


94 


26-30 


112 


31-35 


98 


36-40 


72 


41-45 


37 


46-50 


10 


Total 


700 j 



In this table each group of measures, e. g., to 5, 6 to 10, etc., 
is called a class. 1 For the Class 6 to 10, 6 is called the lower limit, 
and 10 the upper limit. The class interval is the difference between 
the npper and lower limits. In this instance the class interval is 
5 words. The number of measures within each, class interval is 
called the frequency of the class, and its conventional symbol is 
"" The entire tabular arrangement, consisting of classes and 
their frequencies, is called a frequency table or frequency distribu- 
tion. 

On the one hand, it is desirable in the interest of accuracy that 
the number of classes of a frequency table be large, in order that 
the intervals may be small. Obviously, it is much more accurate to 
say that 7 pupils spelled no words correctly, 14 spelled one word 
correctly, etc. (Table I), than to say that 60 pupils spelled from 
to 5 words correctly (Table II). On the other hand, it is desir- 
able that the number of classes be small enough to afford a gener- 
alized or typical result. A good rule to follow is : arrange the data 
in as many classes as will secure the greatest regularity of frequen- 
cies, i. e., in accordance with which the frequencies will as nearly 
as possible increase to a maximum near the middle of the range, 
and then decrease to a corresponding minimum. While tlie number 
of classes in Table I, according to this criterion, is too large, it 
might not be too large if we had five or six thousand measures. 

The graphic representation of the frequency table is called a 
frequency surface or frequency polygon. Figure 1 is a frequency 



*TLere is a slight irregularity in the class intervals in that the first 
class contains six units. 
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surface corresponding to Table II, Observe that the measures, 
grouped by classes, are arranged along the base line. The height of 
each column erected above a given class corresponds to the fre- 
quency of the measures for that class. These frequencies may be 
read from the vertical scale at the left of the figure. 

In Figure 1 the columns rise on either side of the tallest column 
with an approach to regularity. If, instead of 50 words, we had 
500, so that we could make 501 classes, and if the number of pupils, 
(i. e., of measures) were indefinitely increased, the perimeter of 
Figure 1 would approach the form of a smooth curve having a single 
peak near the center and sloping toward the base line to the right 
and left 
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FIGUBE 1. Frequency of Correct Spellings 



45 50 



Horizontal distances represent numbers of words correct; vertical dis- 
tances represent numbers of pupils. Data from Table II. 
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PIGUEE 2. Normal Surface of Frequency 

The base line of sueli a curve is called tlie abscissa. Along It 
are represented the values of the variable. The perpendiculars 
from the curve of the abscissa are called ordinates. They represent 
the frequencies of the values of the variable. The longest perpen- 
dicular is called the maximum ordinate, and the measure repre- 
sented on the abscissa at the foot of it is the most frequent one. 
If a curve is of the symmetrical form shown in Figure 2, the maxi- 
mum ordinate divides the area between it and the abscissa into two 
equal parts. A curve of this form is variously called the Gaussian 
curve, the curve of error, the probability integral, or the normal 
surface of frequency. 

If a smooth curve were drawn to fit as closely as possible the 
frequency surface of Figure 1, this type form (Fig. 2) would not be 
accurately reproduced. Spelling ability, however, among eighth- 
grade boys may, nevertheless, be distributed 'normally.' The pres- 
ent state of our knowledge does not permit us to be sure that the 
words selected would register all abilities among eighth-grade boys. 
Again, details, not here reproduced, indicate that the number of 
children was too small to bring out the real distribution. One small 
school furnished more than half the children who spelled from 
to 5 words correctly, and more than one-third of those who spelled 
to 15 words correctly. Their unusually low performance causes 
the first three columns of Figure 1 to be unduly high. The rem- 
edy, of course, is to obtain returns from, a great many more children. 

Although the arrangement of many measures in a frequency 
table and their graphic representation by a frequency surface per- 
mit the mind to grasp the significance of the data far more readily 



STATISTICAL TE&M8 AND METHODS 121 

titan is possible without such devices, nevertheless farther simpli- 
fieation is generally desirable. The more numerous the measures 
and classes of measures, the greater is the need for concentrated in- 
formation that is, for a single simple expression which shall con- 
tain in itself a summary of the whole series. This is the purpose 
of averages. 

The term average has both a general and a specific meaning. 
In its general sense it means any expression intended to give by a 
single figure, the general weight or typical measure of a series. 2 
In its restricted sense, it refers to the arithmetical mean, L e., to 
the sum of the measures divided by the number of them. This is 
what we generally mean when we speak of fhe average. In edu- 
cational statistics, the term used to express the general concept of 
average is central tendency (C. T.). As has been stated above, 
series of educational measurements, when properly derived, tend to 
exemplify the theory of error, i. e. (to state the case very crudely), 
there is a part of the series where the measures are most numerous, 
while the other measures become fewer, the more they differ from 
the most frequent measure. Unless this condition is approximated, 
it is not appropriate to speak of a ' central tendency.' We may, in- 
deed, make an arithmetical computation. The average of the an- 
nual enrolments of an institution which is steadily increasing in 
size may thus be found and will have its uses, but it will not be 
typical of any tendency in the measures. 

Since we are permitted, however, from the nature of educa- 
tional data to use the term 'measure of central tendency,' it will 
be best to use the term ' average' in its commonly accepted sense, 
as meaning the sum of the measures divided by the number of them. 
Some writers call this the "arithmetical mean," or simply the 
"mean." 

The three measures of central tendency (C. T.) most fre- 
quently used are the average, or arithmetical mean (A), the median 
(M), and the mode (Z). The median has been defined as the mid- 
most measure of a series whose measures are arranged in order of 
size, beginning with the smallest or the largest. According to this 
definition, the median is the 5?th measure (N being the number 
2 See, for example, Zizek, Franz. Averages. 
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of measures) . There are objections to this conception of tie median, 
and recent workers have defined it as a point on the scale on each 
side of which half the measures lie when they are arranged in order 
of magnitude. The significance of this definition is that it em- 
phasises the idea of a point on the scale rather than a measure. The 
measures in Table I are arranged in order of magnitude. Half the 
number of measures (pupils) is 350. From the beginning through 
Step 23, there are 342. Bight more measures are needed to com- 
plete the 350. These are all contained in Step 24, which may, there- 
fore, be called the "median step." Since the series is to be re- 
garded as continuous, we must seek the M the " point on the scale 
on each side of which half the measures lie ? ' somewhere in Step 24, 
i e., between 24 and 25. "We now assume that the 14 measures en- 
tered at "24" in the table are uniformly distributed between 24 
and 25. Since we need 8 of them, M will be 8-14 of the way from 
24 towards 25. Hence the M is 24+8-14 or 0.57 of the step. The 
step is 1 ; therefore the M is 24.57. If we count from the other end 
of the table, we obtain the same value, thus checking the compu- 
tatdon* 

If the data were available only as in Table II, the M would be 
found to be 24.88, instead of the more correct 24.57, as computed 
from Table I. Thus, the greater regularity of Table II is gained 
at the usual sacrifice in accuracy. 

Series may have but single measures at each value, and there 
may be more or less wide gaps in the values. If the number of 
measures is odd, M is the middle one; if even, it is the average of 
the two middle measures. For example, if the expenditures per 
pupil for 35 cities are listed in the order of their amounts, M is the 
expenditure of the 18th city. If there are 36 cities, M is the aver- 
age expenditures of the 18th and 19th cities. 

The median may be used when the items have been merely 
ranked, instead of measured. Thus a teacher may arrange the com- 
positions of a class in the order of their merit according to her 

*If there were 701 measures made, let us say, by including one pupil who 
spelled 37 words correctly, we sliould find tlie 35.0.5th. measure. "We should 
then need 8.5 of the 14 measures at Step 24, and M would be 24.61. 
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judgment. 4 The middle one (or the two middle ones, if there are 
an even number of them) is the typical performance of the class. 
Such typical samples may be compared with others similarly ob- 
tained at later dates, and thus a showing of the progress of the 
dass may be made. To add to the definiteness of this, the median 
samples may be measured by a composition scale. 

It was pointed out above that the nature of the units in which 
measures are expressed must be clearly apprehended and con- 
sistently adhered to. Failure to do this introduces error in all 
the results of statistical analysis. An illustration of such an error 
made in the computation of medians may be found in the report 
of the Salt Lake City Survey. In the Table (p. 140) showing the 
distribution of composition scores by grades, failure to take ac- 
count of the nature of the unit resulted in reporting medians which 
were too small by an amount greater than the average annual im- 
provement from grade to grade. The teachers rated the composi- 
tions according to the original Hillegas scale. The values of the 
samples on the published scale were 0, 183, 260, 369, 474, 585, 675, 
772, 838, and 937. In reporting the ratings of the teachers, how- 
ever, these values were called respectively 0, 1, 2, 3, 4, etc., and in 
computing the median these latter values were the ones used, and 
they were called the mid-points of their respective class-intervals. 
Accordingly, when a teacher rated a composition as 3, (really 369) 
she was regarded as placing it between 2.5 and 3.5. As a matter 
of fact, she was placing it as nearer to 369 than to 260, or 474, and 
the class-interval was* therefore from 314.5 to 421.5. The median 
for the 4th grade was found to lie four-tenths of the way into the 
class called "3** in the table, and, since the lower limit of this class 
was taken as 2.5 and the interval as 1, the median was reported as 
2.9. The lower limit, however, for the class was really 314.5 and 
the interval 107. This yields a median of 357.3 (3.415 + 107 X 0-4) 
or, shifting the decimal point for convenience and expressing the 
result correctly to one decimal place, 3.6, instead of 2.9 as reported. 

The mode is the most frequent value in a series. As such it is 



4 TMs may be done very accurately "by making all possible comparisons of 
two papers and giving 1 the better paper of each pair a preference mark. The 
paper having the greatest number of preference marks is the best paper; the 
one having the next greatest is the next best, etc. 



124 TEE 

the most evident measure of C. T. It is what most people think of 
when they speak of the average. A teacher, if asked her pupils' 
average a^e, will probably reply by giving the most frequent age. 
The mode, therefore ? is peculiarly dependent for its significance, 
and indeed for its existence, on the structure of a series. There 
may, indeed, be more than one mode in a series, but in educational 
work the presence of two or more modes indicates a probable fault 
in the procedure. 

"We may distinguish the empirical made and the theoretical 
mode. The former is obtained by inspection. It is taken as the 
mid-value of the class-interval containing the largest mxmber of 
measures. It, therefore, depends on the size and position of the 
classes in the frequency table. This suggests that by varying the 
size and position of classes we may obtain different values of the 
mode and by combining them, arrive at a more accurate value of it 
than is possible with a single determination. This method is de- 
scribed in most of the textbooks. 5 

The theoretical mode is not obtained directly from the data, 
but is the mode which would result from, an indefinitely large num- 
ber of measurements sub-divided into very minute classes. Its most 
satisfactory determination is based upon fitting an ideal frequency 
curve to the actual series. The value of the variable corresponding 
to the maximum ordinate of the fitted curve is the theoretical mode. 
Its determination involves some rather advanced work in mathe- 
matics, and it is not being used in educational measurements. A 
substitute for this method has been suggested and is said to work 
well. According to it 

Mode = Average - 3 (Average Median) 

The average for the series given in Table I is 23.91. The median, 
as shown above, is 2457. The formula just cited yields 25.89 as 
the value of the mode. 

"When the performance of pupils is recorded in the form of 
rates, e. g., of words read per, second or letters written per minute, 
a measure of central tendency sometimes used is not the average 
of the rates, but their "harmonic mean. This may be defined as the 

"See Bowley, Arthur L., Tfie Elements of Statistics, London, 1907, pp. 
118ff.; also King, Wilford I., The Moments of Statistical Methods, New York, 
1912, pp. 122-125. 
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reciprocal of the average of the reciprocals of the recorded meas- 
ures. Suppose five pupils read at tlie following rates per minute : 
A, 80 words; 5,100 words; G, 120 words; D, 140 words; and JET, 
160 words. 6 The average of tliese rates is 120 words per minute. 
The reciprocal of each rate expresses the actual time required by 
each pupil to read one word. Thus, A required 1/80 min., or 
0.0125 min., to read one word; B'$ time was 0.01 min. ; C's, 
0.00833 min. ; D's, 0.00714 min. ; and E'$, 0.00625 min. The aver- 
age of these is 0.00884 min. It shows the average time required to 
read one word. The reciprocal of this average of reciprocals is 
1/0.00884, or 113 the average number of words read per minute 
as computed by finding the harmonic mean. Note that we have 
found the average of the reciprocals of the rates and taken the 
reciprocal of the result. The average rate by this method is 113 
words, while the average by using the rates directly is 120 words. 
The harmonic mean is always less than the Average. It is, there- 
fore, clear, that results as found by different investigators are only 
comparable when computed by the same method. 

On practical grounds it is difficult to see why we need the har- 
monic mean as an alternative method in computing the central 
tendency of rates. There is no essential difference between rates 
per unit of time and certain economic measures such as wages per 
day. It is certainly not customary to express the central tendency 
of the wages of a group of workmen by using the harmonic mean. 
In the judgment of the writer, the introduction of this method in 
educational reporting serves no useful purpose. 

A measure of C. T., although indispensable, by no means suf- 
ficiently represents a series. It gives but one of the two chief char- 
acteristics of it. The second of these is the closeness with which the 
measures group about the C. T. The measure of this characteristic 
is called the measure of variability, or dispersion. There are three 
such measures in common use, and one of them should be used and 
reported, not only for its own sake, but also as a criticism of the 
measure of central tendency. All measures of variability, like those 
of C. T., are expressed in units of the series. For example, if the 
units of the series are words spelled, the C. ,T., as well as the varia- 



6 Gray, William S., Studies of Elementary-School Reading Through Stand- 
ardized Tests, p. 15. 
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bility, will be expressed as a certain number of words. The aver- 
age devmii(m (A. D.) also the mean deviation, or mean variation 
is simply the average of the amount by which each of the measures 
differs from the average, median, or mode. It is being suggested 
by several writers that on theoretical grounds the A. D. should be 
computed from the median, because when so computed for any 
series, it is at a minimum. People in general do not sense the mean* 
ing of the A. D. or any other measure of variability as readily as 
they do a measure of central tendency. The A. D. may be thought 
of as the amount by which every measure of the series might differ 
from the C. T. without influencing it. 

The standard deviation (S. D. or <r) is another measure of 
variability. It is found by squaring the difference between the in- 
dividual measures and the C. T., adding these squares, dividing by 
the number of measures, and extracting the square root of the quo- 
tient. The S. D. is theoretically the best measure of variability 
at least when the series is 'normal' or nearly so. Its meaning, how- 
ever, is not apparent to the lay reader, and it is difficult to explain 
in terms of the series. If, in Figure 2, perpendiculars are drawn 
from the two points on either side of the maximum ordinate at 
which the curve changes from concave downward to concave up- 
ward, the distance along the base line from the foot of the maximum 
ordinate to the fdot of either perpendicular represents the S. D. 
Between these perpendiculars a little more than two-thirds of the 
area of the curve is included. In series, therefore, which approxi- 
mate the normal type, we may expect about two-thirds of the meas- 
ures to differ from the C. T. by not more than the standard devia- 
tion. The S. D. is at a minimum when computed from the average ; 
and according to the best practice, it is therefore taken from that 
measure rather than from the median or mode. 

The quartile deviation (Q) is half the range within which the 
middle half of the measures lie. In its computation one finds the 
three points in the range which divide the number of measures into 
four equal parts. These points are found in exactly the same way 
as the median. The points on the range at which these divisions 
fall are called the quartiles. The first, or lower one, is called the 
lower quartile, or 25-pereentile (Q ) ; the third or highest one is 
called the upper quartile, or 75-percentile (Q 3 ). The second one, 
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of course, divides the measure into tlie two equal parts and is the 
median; it is not, therefore, referred to as a quartile. The differ- 
ence between the upper and lower qnartile is the range within which 
half the measures lie. This difference divided by 2 is Q. In the case 
of normal distributions, it is called the probable error (P. E.). 

It is important that the student of educational statistics should 
understand not only that A. D., S. D., and Q are measures of varia- 
bility, but also that they are themselves important units of amount, 
and that for some purposes they replace the units in which the 
measures were recorded. Suppose that a group of eighth-grade 
pupils is tested in arithmetic and in handwriting. If a certain 
pupil scores 17 examples correct in arithmetic, and Quality 75 in 
handwriting, according to the Ayres scale, it is impossible to say 
how much the one performance is better than the other, unless both 
performances are expressed as a certain number of A. D ? s or Q's 
above or below the median of the group. Either of these units, or 
the S. D., will serve to express the measures of a series in such a 
way as to permit comparison with the measures of another series 
expressed in the same units of variability, even though the original 
units of the two series are different. 

If it is desired to compare the variabilities of two different 
series, we can hardly do so by using either of the three measures 
described above. If, for example, a group of children is rated in 
composition by the Nassau County Supplement to the HUlegas 
Scale, and in spelling by means of a list of 100 words, since the 
possible range of achievement in composition is only from to 9, 
while in spelling it is from to 100, the variability in the latter 
case will appear to be much greater than in the former. Under such 
circumstances, it is customary to divide the measure of variability 
by the C. T., the result being the so-called coefficient of variation. 
G-eneraJly speaking, it is an error in method to compare the meas- 
ures of variability of two series unless the series are expressed in 
the same units and have approximately the same C. T. 

Although the analysis of series may be carried to higher de- 
grees of refinement, educational workers report few measures other 
than those of central tendency and variability. No small space, 
however, in educational literature is devoted to the determination of 
the degree of correlation, or mutual implication, existing between 
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paired measures of different traits or performances. Thus, if 100 
high-school children are rated in Latin and in algebra, the extent 
to which an individual having high, medium, or low ratings in one 
subject tends also to have high, medium, or low ratings in the other, 
indicates the correlation for the group in question between ratings 
in Latin and ratings in algebra. Various methods have been de- 
vised for giving numerical expression to this correlation between 
two series of paired measures. Two of the methods suggested by 
Spearman the "Rank Difference" and the "Footrule" depend 
on the extent to which the individuals ranking first, second, third, 
etc., in one series tend also to rank in the same order in the other. 
Such a correspondence in ranking would indicate perfect correla- 
tion, and would be expressed by the integer 1. By another method 
(suggested by Sheppard) each measure in the two series is given a 
sign plus or minus, according as it is greater than or less than the 
central tendency, and the number of times a plus or a minus sign 
in one series goes with the same sign in the other series for the same 
individual is noted. The greater the proportion of "like-signed 
pairs," the greater is the correlation. The formula which is used 
in connection with this method again yields "1 >J as the measure of 
perfect correlation, i. &., as the measure obtained when all the pairs 
of signs are alike. 

Still other methods are used, but the so-called product-moment 
method is the one most commonly accepted. The meaning of the 
formula used in applying this method cannot be made clear in a 
brief description. The reader is referred to any textbook on statis- 
tics for a treatment of it. The measure of correlation yielded by 
this method is called the correlation coefficient, and its symbol is 
ef r.' 9 To such an extent is the product-moment method, the stand- 
ard in statistical work that coefficients derived by other methods 
are usually converted into it. 

In determining the degree of correlation which subsists in a 
given group with respect to two measurable characteristics, it must 
be emphasized that the individual measures, pair by pair, are to 
be used. It is not correct procedure to break the group up into 
smaller sub-groups and to compare the averages in the two charac- 
teristics for each group. Averages obscure individual variations 
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and It Is precisely the individual variations which are important in 
securing a correlation coefficient. 

The correlation coefficient as an expression of relationship has 
been uncritically adopted. It Is a measure of mutual Implication. 
It fails to indicate the extent to which either of the measured char- 
acteristics depends upon the other. It may, however, be used In 
finding other expressions which do so. Thus, statisticians, while 
becoming more critical of the correlation coefficient, are using it to 
determine the two so-called regression coefficients , which permit a 
statement of the chance in one characteristic likely to accompany 
a unit change in the other. I found, for example, that the correla- 
tion coefficient between achievement in answering thought and mem- 
ory questions in history was +0.40. This was not nearly so inf otm- 
ing as were the regression coefficients, one of which showed that suc- 
cess In answering thought questions accompanied success in an- 
swering memory questions to the extent of nearly 0.90 "1** being 
the maximum. The other regression coefficient, i. e., of t memory* 
on ' thought/ was less than 0.20. 

Most of the foregoing statements, and many others not made 
here, depend to a large degree for their validity upon the existence 
of c normal' distributions. Although the ability of school children 
In a given grade is presumably close to normal, measurements ob- 
tained from test material often fail to support the presumption. 
Aside from the fact that the pupils ' measured' are often relatively 
few and poorly selected, and that results are frequently scored by 
interested or Indifferent persons, there Is another important reason 
for this a reason which has to do with the test itself as a measuring 
device. 

It is necessary, in the first place, to understand clearly what it 
is that we are measuring when we test school children. Mr. Courtis 
has pointed out a useful distinction between capacity, ability, and 
performance. 7 Capacity, as he defines it, represents the possibility 
of development the natural endowment of the individual. It is 
his potential ability, and is independent of training. The ability 
of an individual is defined as the power actually developed by the 
effect of training upon inherent capacity. Performance is the spe- 



7 Ccrartis, S. A., TJwrd, Fourth, and Fifth Annual Accountings, 1913-1916. 
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cific achievement of an Individual resulting from Ms ability as 
evinced under the conditions of the test. 

Although we may have good reason for supposing that the 
distribution of school* ability Is closely similar to normal distribu- 
tion, we see in the distinction which has just been made, that what 
we are really measuring Is not ability, but performance, and that 
while ability may be constant at any particular time, performance 
wIU vary according to the conditions under which the ability mani- 
fests Itself. This constitutes a real difficulty in educational meas- 
urements, especially when conclusions are drawn concerning In- 
dividuals rather than groups of individuals. It has been proposed 
that as many as twenty-five tests of a single Individual ought to be 
made and the average of the results used before we can be reasonably 
certain that we have a reliable measure of performance. This is 
an extreme point of view and seems hardly to be tenable. Courtis 
has shown that If children are given a second test, only about 20 
percent of them will show marked differences in performance. He 
has also shown that giving additional tests does not materially 
change the score for a class as a whole. 

Since, however, what we are measuring is performance rather 
than ability, our tests must be so constructed that performance will 
tend to vary with ability, i. e., to be an index of it. Thus, the con- 
formity of the resulting measures to a normal distribution furnishes 
a criterion for judgment as to the adequacy of the test material. 
Assuming that ability is distributed approximately normally, it 
Is highly desirable that the test material should be such as to bring 
out that form of distribution. Too often this is not the ease. On 
this ground a great deal of test material now being used in edu- 
cation is faulty. For example, most of the testing which has been 
done In spelling by using Dr. Ayres' list has resulted in a large 
number of perfect papers, or papers that were nearly perfect. This 
is because the examiner has chosen words which Dr. Ayres found 
possessed little difficulty for the grade in question. Recently, re- 
sults were published from the use of words, each of which, accord- 
Ing to Dr, Ayres 5 list, had been spelled correctly by 88 percent of 
the children. Naturally, a very great number of the children 
spelled all the words correctly. Under such circumstances, no meas- 
ure of central tendency could be regarded as significant. In the 
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fourth grade, 15 percent of the children wrote perfect papers. More 
of them spelled all the words right than spelled any other number of 
them. The test material was too easy to register variation in per- 
formance among the more capable children and therefore failed to 
afford any index of their ability. It is certain that among the chil- 
dren who spelled all the words correctly there was a wide difference 
in ability which would have caused a correspondingly wide differ- 
ence in performance, if the material had been, capable of showing it. 
The same inadequacy of test material Is revealed when It is too diffi- 
cult for the pupils to whom it is presented. Under such circum- 
stances a large number of children of varying degrees of ability 
will be unable to register any performance in terms of the test. 
For example, in a certain test in arithmetic 145 children out of 943 
were reported as unable to solve a single problem. Among these 
children large differences in performance corresponding to large 
differences In ability would have been indicated by a different test, 
i. e. y by one easy enough to enable them to accomplish something. 

The best test material will be found to be midway between that 
which, through being too easy, fails to register variation among the 
pupils of greatest ability, and that which, through being too diffi- 
cult, fails to register variation among those of least ability. A 
spelling test, for example, composed of words, each of which may be 
expected to be spelled correctly by 50 percent of the children In the 
grade taking the test, will afford Ideal results. In general, test 
material is more adequate which yields a series of measures with an 
approximately normal distribution. Any piling up of measures 
at either the high end or the low end of the range is a defect. Such 
material is impossible when given to pupils In several successive 
grades. In the writer's judgment, no test is satisfactory when used 
in grades more than two years apart. 

Various types of tests are being used to measure educational 
products in terms of the performance of children. Dr. Ayres has 
distinguished three. First, there are those in which the material 
is arranged by steps of Increasing difficulty from very easy to very 
hard, such as Gray's Oral Beading Scale, and Woody 's Arithmetic 
Scale. These may be called difficulty tests. They measure "how 
hard." Second, we have accuracy tests, or those which measure 
"how well." Examples of these tests are the various reading tests 
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which measure the quality of reading by the accuracy of the re- 
production odt it. Third, we have tests in which the material is in- 
tended to be of the same difficulty throughout, and in which the 
pupil is required to do as much work as he can in a given time. 
This Mud of test may properly be called a speed or rate test. It 
measures r ' how much. ? ' Doubtless we should measure performance 
by aU three of these devices. Ultimately we shall have at each point 
of as set up in the first type of tests, a large number of 

elements words, problems, passages to read each of the same dif- 
ficulty, The arithmetic tests used in the Cleveland Survey are an 
approach to this. The criticism of the difficulty tests which have 
a single element at each step is that the difficulties of the elements 
are of different kinds. The criticism of the accuracy and rate tests 
is the varying difficulty of their elements. If, however, we have a 
large number of elements at each level of difficulty, we may then 
apply the kind of measurement used in the second and third types 
of tests, and, wifhin the difficulty in question, we may measure both 
"how well" and "how much." Under such circumstances, our 
record of performance would, so to speak, consist of three dimen- 
sions. It would also afford a better index of ability. 

Meanwhile, many new tests are needed, as well as much re- 
finement of the material of tests now in use. It is unnecessary at 
this time to decide the relative merits of difficulty, accuracy, and 
rate tests. At present, the best criterion to apply to these types 
of tests is that of the regularity of the series of measures derived 
from them. If we are warranted, as it seems we are, in inferring 
that ability is distributed with an approximation to normality, then 
the highest requirement on the part of a test is that it measure per- 
formance in such a way as to be a true index of ability. The con- 
ditions under which tests are administered and the methods by 
which they are rated must be rigorously controlled, but the first 
requirement is that the means of measurement should be sensitive 
instruments, capable of registering variation in the things which 
they presume* to measure. We may labor ingeniously at our anal- 
yses of results and may bring from afar the most potent methods 
which statistical theory has evolved, but we shall accomplish little 
if our instruments are as grossly defective as some of those which 
are now being employed appear to be. 
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The rapid growth, of the movement for measurement and the 
importance of the knowledge gained from surveys and experimental 
studies have led to a demand for definite training in measurement 
work. From superintendent to teachers, educational workers have 
been quick to recognize both the possibilities of the new tools and 
their own need for training. Wherever courses in measurement 
have been offered, the response has been surprisingly large. As a 
result the number of courses available in colleges and universities 
is steadily increasing and their influence Is spreading to other fields. 
There are few teachers' institutes which do not touch upon some 
phase of measurement work, and few normal schools or other teacher 
training agencies which are not beginning to arrange for systematic 
instruction along these lines. At present there is, as might be ex- 
pected, almost no agreement as to the aim or method. The courses 
range from the shallowest survey of the literature of the field, to the 
most highly technical and theoretical courses of -university psychol- 
ogy. It may not be out of place, therefore, to give some account of 
the needs of teachers as seen by otae who has served for several 
years as director of research in a large city school system. 

The primary aim of all courses for teachers must be to increase 
the teaching power of the students. But teachers are the stuff 
from which principals, supervisors, and superintendents are made, 
so the- training courses must be both broad enough, and wide and 
deep enough to give some knowledge of the administrative and 
supervisory uses of tests as well as of their instructional and diag- 
nostic functions. For most teachers, practically the only opportun- 
ity to consider the workings of the school system as a whole and to 
think about educational problems from the supervisory and admin- 
istrative standpoints is that which comes to them during the period 
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of training. Therefore, while the measurement work in a normal 
center around the direct application of measurement 
to the solution of problems of teaching, the broader aspects of the 
results secured must not be overlooked. 

The desirable outcomes of courses in measurement, as of other 
instructional work, are of four different types (1) point of view, 
(2) knowledge, (3) skills, (4) power. Each of these will be dis- 
cussed in tarn, 

1. Of all the possible outcomes of training work in measure- 
ment, none is so important as the effect upon thp student's point 
O f vfettf upon Ms attitude, not only towards scientific experimenta- 
tion in education, but also towards his educational experiences and 
life. For, too often, normal-school courses result merely in giving 
the prospective teacher the idea that everything in education is 
settled. A textbook is necessarily dogmatic in statement. Courses 
in methods and teachers in charge of training necessarily tend to 
stamp this as right and that as wrong. The training period is al- 
together too brief to do more than outline existing ideals and prac- 
tices, and indicate those that are "the best" Even practice teach- 
ing under expert guidance usually serves but to give practical 
experience In "handling a room 77 and in conforming to teaching 
routine. Occasionally, a student of exceptional intelligence senses 
the contrast between ideals and existing conditions, but even his 
experiences seldom stir more than questionings and dull resent- 
ment. 

Teaching, itself, Is even more deadening to initiative. In all 
systems of any size the courses of study, and often the method to 
be used, are fixed by higher powers. The equipment, the time allow- 
ances, the size of classes, the types and abilities of the children, are 
all beyond the teacher's control. What is there in the training or 
experience of the average teacher to develop openness of mind, 
or give any conception of our present educational process as a crude, 
inefficient, wasteful makeshift, established "by guess and by gosh," 
and maintained by convention and social inertia? 

Therefore, it should be the supreme function of measurement 
courses in normal training as it has proved to be in the educa- 
tional activities in the world outside the school to give the student 
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the scientific attitude of mind, the critical, impersonal, and inquir- 
ing point of view. They must teach him how knowledge arises and 
make him feel the cost in time and labor by which the present levels 
of civilization have been attained. They should so clearly reveal 
the part that measurements and scientific methods have played in 
every field of human activity that he will realize their importance 
in education and desire to make himself proficient in their use. 
They must give Mm bases of criticism and arouse in Mm such a 
passion for truth that all his life long he will constantly seek to test, 
open-mindedly, disinterestedly, impersonally, the validity of all 
conclusions. They should lead Mm to regard all educational ac- 
tivities as problems in course of experimental solution, so that he 
will be ever on the watch for those significant variations which make 
for progress. Above all, they must so open Ms eyes to the wonders 
of the educational process, the possibilities of cMld development, 
and the relation of progress in education to progress of the world 
that he may have an abiding faith in the dignity and value of his 
profession and a burning zeal to make some contribution to the 
progress of the race. If the courses do this, they will be counted 
successful long after all technical knowledge and skill has been for- 
gotten ; if they do not, they are failures, although their graduates 
know every test by name and are past masters in the art of compil- 
ing tables and graphs. 

2. On the side of knowledge there is much to be learned. The 
student must acquire by actual experience, knowledge of the differ- 
ent types of tests and the advantages and limitations of each. He 
must be familiar with the methods of test and scale construction 
and must have a first-hand experience in giving and scoring the 
more important of the available standard tests: He needs to know 
where to go for standards and comparative data, and he should 
have made a careful, critical study of two or three typical survey 
reports. He must be given, also, some experience with the varia- 
tions in performance caused by changes in conditions and must 
learn how these are to be controlled and interpreted. More than 
anything else, Ms practical work must serve to emphasize the differ- 
ence in individual children and the need of adjustment of training 
to such differences. 
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It is not enough, however, that the teacher In training have a 
practical working knowledge of educational tests; he must know 
also tests in related fields. He should be given more than a passing 
acquaintance with physical measurementsheight, weight, lung 
capacity, and their significance, and simple tests of vision and hear- 
ing. He needs also some knowledge of the methods and tests em- 
ployed in measuring intelligence and capacity. Further, he needs 
practice in the construction of rough tests and examinations, and 
the formulation of aims in terms of objective standards. Knowledge 
that is only knowledge, is vain. If the knowledge outlined above 
is merely memory of things read or transmitted by word of mouth, 
it will be of little worth. It should be knowledge derived from per- 
sonal experiences. 

3. The other product of experience is skill, and the successful 
course in educational measurement will have as one of its outcomes, 
the ability to pass certain standard tests in, statistical methods ; for 
instance, rate tests in making typical distributions, in finding aver- 
ages and medians, in computing median and standard deviations, 
in calculating coefficients of correlations, and in drawing graphs. 
Even more important than these are standard tests of ability to 
use educational scales in a consistent manner. There should be 
training on some of the standardized samples which have been pub- 
lished in writing and composition, until a set of 20 test samples can 
be marked without a variation of more than half a step of the scale. 

Only as the course results in a measurable proficiency in these 
fundamental skills should it be counted successful. Not all persons 
have the mental qualifications that make possible accurate judg- 
ment by means of a scale, and not all have the aptitude for statis- 
tical work; but all teachers, without exception,?iee<2 to Jiave meas- 
ured themselves against such objective standards, both that they 
may know their own powers or limitations, and that they may un- 
derstand the method and aims of those who have the measurement 
work in charge. The greatest obstacle to harmonious, cooperative 
work in a city school system is the misunderstanding of those who, 
through ignorance, misintelrpret the aims of the measurement work. 

4. Finally, the successful courses in measurement should re- 
sult in power to use measurement in the solution of educational 
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problems. That is, for full credit, the student should be able to 
pass successfully three types of power tests; (1) he should have 
planned, measured, and compared the effects of his own and an- 
other's teaching of a specific instruction unit, like the teaching of a 
given twenty words in spelling, or a certain case in long division ; 
(2) he should have devised, executed and interpreted a simple con- 
trol experiment to settle some problem arising out of Ms practice 
teaching; (3) he should be able to diagnose by means of appropri- 
ate tests, and to prescribe the remedy for, the more common causes 
of failure in the fundamental subjects. No teacher who has: had the 
practical experience with tests and testing that will enable him to 
meet these requirements will ever be willing to teach without the 
aid which standard tests afford. 

There are five major articles in the writer's educational creed : 

1. Basic experiences cannot be transmitted by instruction. 

2. Understanding of the value of tools is best learned by their 
use as a means to an end. 

3. SMll in the use of tools is best developed through drill. 

4. Outcomes related to self-interest have greater educational 
potency than abstract aims. 

5. All training work must be adjusted to the varying capaci- 
ties and interests of individual students. 

Expressed in terms of method of teaching a course in meas- 
urement these mean : 

1. That the work must be "practical" in character. 

2. That it must center around, and have for its purpose, the 
measurement, and improvement, of the practice teaching. 

3. That it must consist mainly of laboratory work with only 
as much lecture work and reading as is necessary to connect the ac- 
tivities of the course with similar activities in the school system 
and in the educational world outside. 

4. That it should consist of a series of graded exercises or 
projects grouped around the main topics in such a *way as to pro- 
vide for individual progress and differences in interest. 

It seems futile to attempt to give more specifically a statement 
of precise topics covered, or the length of the course in terms of 
years or hours. Adjustment must everywhere be made to local 
conditions. But the material available and its importance warrants 
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the prophecy that in a very short time the work in measurement 
will be a major subject running through the entire period of train- 
ing. For a six semester course (four semesters in school and two 
actual teaching under supervision), the following might serve as 
a general program. For shorter courses, the actual amount of work 
done would be correspondingly decreased. 

Semester I. General principles of measurement, including 
physical and mental tests, and elements of statistical methods, with 
special emphasis on individual differences, the factors causing vari- 
ation, and the need for control of conditions. 

Semester II. Use of the simpler standard tests in measuring 
the effects of practice teaching. 

Semester III.. Measurement by means of the more complex 
tests, with special emphasis upon correlation of abilities and analy- 
sis of complex ability into simple elements. 

Semester IV. Measurement of the results of educational ex- 
periments and of the effect of remedial work with individual chil- 
dren. Emphasis on the diagnostic and supervisory uses of tests, 
both for individuals and for a school system as a whole. Class as- 
signments mainly individual projects, or actual participation in 
surveys and other practical testing work. 

Semesters V and VI. Period of probationary teaching. Re- 
ports to supervisory officers to be based on the use of standard tests 
of the results of teaching effort. 

An appropriate conclusion to this chapter is a comment on 
that anomaly a course on educational measurement in which no 
use of measurement is made, either as a basis of adjusting the work 
to the abilities of individual members of the class, or as a means of 
measuring the efficiency of instruction. As long as educational 
training concerns itself with superficial conformity to conventional 
practices and hasty surveys of educational literature, little in the 
way of progress can be expected. But if the work in the training 
and practice schools is actually the most efficient in the system, and 
if there, the teacher-in-training learns to see problems as problems, 
and to attack them with the best tools and methods, the training 
which he receives will function all through his professional life. 
Probably upon the character and practical value of the instructions 
given to prospective teachers, more than upon any other one factor, 
depends the success of the movement for measurement and the char- 
acter of its future development. 



CHAPTER XI 
SUGGESTIONS FOR EXPERIMENTAL WORK 



BY GEOBGE MELCHER, 

Director of Bureau of Eesearch. and Efficiency, 
Public Schools, Kansas City, Missouri. 



EMPIRICISM: AND SCIENCE IN EDUCATION 

The United States lias no national system of education. Each 
state, each municipality, each school district plans its own course of 
study, determines its own school organization, supervises its; own 
school work, chooses its own plan of procedure, establishes its own 
standards. Our nation is called "the world's greatest experiment 
in democracy." With equal truth it could be called "the world's 
greatest experiment station in education. ' ' All kinds of educational 
problems are being attacked experimentally problems in the ad- 
ministration, the supervision, the teaching and the financing of 
schools. All varieties of curricula are involved, all kinds of school 
equipment and appliances, and every conceivable method of teach- 
ing the various subjects. 

Many communities believe that their methods of school pro- 
cedure are the best. Yet they are wholly without scientific evidence 
in support of their belief. Thus it is often easy for an enthusiastic 
devotee of some new method of procedure to influence the agencies 
of control to such an extent that an entire school organization is 
revolutionized. Witness the change of a large number of elemen- 
tary schools in New York City to the Gary plan of organization. 
We are not arguing that New York City has not improved her 
schools by the change ; for we do not know whether she has or not. 
New York City does not know. No one knows. The Gary System 
may have many valuable contributions to make to education. The 
point is that the plan is new and has not been in operation long 
enough to have demonstrated its superiority over the conventional 
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school organization. Yet, in spite of that fact, the Gary system has 
been and is being enthusiastically copied not only in New York City 
but in many other communities as well In like manner, countless 
other changes in school organization and school procedure are be- 
ing made year after year on the basis of plausible arguments ; and 
no one is able to demonstrate the wisdom of the change. In many 
eases a few years later the school returns to its original plan. Wit- 
ness the more recent action at New York in abandoning the Gary 
plan after spending several million dollars in introducing it. Could 
industrial establishments succeed by such methods ? 

School authorities are constantly changing methods of pro- 
cedure, and courses of study. This harasses teachers, annoys pa- 
rents, lowers the efficiency of work, and destroys the confidence of 
the public in its school system. Such arbitrary orders are based 
merely on the personal opinions of those in authority. Even up 
to the present time, almost every school policy has been adopted on 
insufficient evidence or upon no evidence at all. In other words, 
personal opinion decides the destinies of school children and de- 
termines school curricula and school organization. Scientific 
methods have been recently introduced into industrial work, busi- 
ness, agriculture, and many other forms of human activity. Even 
the church is having its methods subjected to rigorous criticism 
from the standpoint of efficiency. In the management of the war, 
we see great nations struggling to apply every known scientific 
principle. Certainly education, the most important of human in- 
dustries, cannot afford to neglect any opportunity to test scien- 
tifically its methods of procedure and to demonstrate the value of 
its results. 

In this chapter I am to make a few practical suggestions 1 that 
may be helpful to the teacher, principal, supervisor, or superin- 
tendent who desires to contribute his "bit" to educational progress. 
These suggestions will be valueless to the persons who still believe 
that we can measure achievements in school work by the personal 
opinion frequently the offhand and prejudiced opinion of some 
one individual. "We know that improvement in all human activities 
depends very largely upon critical studies of existing conditions and 
upon the establishment thereby of standards to be attained at each 
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stage in the development of these activities. It is evident that 
progress in education is dependent upon a similar process. The 
inability of school administrators in the past to make reliable meas- 
urements has greatly retarded progress. It is true that they have 
been able to measure such facts as per capita costs, numbers and 
ages of graduates, the percentages of retardation, etc. Helpful as 
such measurements are, they fail to yield the information upon 
which an adequate appraisal may be based. The recent development 
of means of measurement, however, permits true educational ex- 
perimentation. 

METHOD OF COMPARISON 

In order to determine progress in any phase of school work, 
one must first analyze the situation to discover, as far as possible, 
the various factors that enter into it. These factors must then be 
studied singly and the effect of each determined. It is 1 the analysis 
of these complex situations and the study of each of their factors 
that renders educational measurement* so difficult. This is espe- 
cially true in attempting to compare the efficiency of different meth- 
ods of school supervision, organization, or administration. 

It is probable that experimental work can render its greatest 
service by being applied to a study of methods of teaching and of 
the organization of subject matter. These problems are constantly 
before superintendents of schools and one or more of them can be 
selected each year for special study. The mere fact that they are 
being studied will have a beneficial effect upon the school system. 

As we do not have standards in all school subjects, it is nec- 
essary to employ many other means of measuring school achieve- 
ments. One device, concerning which a few suggestions will now 
be offered, is the 'Control Experiment.' In order that the con- 
clusions from a control experiment may be of value, a careful plan 
of procedure must be followed. 

First. Analyze your situation and select one factor to be 
studied. 

Second. Select two groups of pupils approximately equal in 
number, in ability, and in previous training. Each group may con- 
sist of one, two, three, or more classes. 
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TMrd. At the beginning of the experiment, carefully meas- 
ure the ability of each pupil in the factor under consideration. 

Fourth/ Select teachers who are open-minded. If possible. 
select those who know something of scientific methods. Especially 
select those who are willing to cooperate and who appreciate the 
value of following directions. The teachers should be as nearly 
equal as possible in teaching ability. 

Fifth. Prepare carefully detailed instructions for all teach- 
ers who are participating in the experiment. 

Sixth. Except for the one factor that is being studied, keep all 
the conditions in the two groups as nearly equal as possible during 
the progress of the experiment. 

Seventh. Continue the experiment long enough for material 
changes to be made several weeks, half a year, or even more may 
be necessary. 

Eighth. At the conclusion of the experiment, carefully meas- 
ure the ability of the pupils in the factor under consideration. 

Ninth. Base conclusions as to relative efficiencies upon a study 
of gains and losses of only those pupils who were present through- 
out the period of the experiment. 

Tenth. Allow for the effects of any varying factor other than 
the one under consideration. 

Eleventh. Avoid conclusions from insufficient data. 

Twelfth. Eecord and preserve the detafts of the procedure.. 
It may prove to be desirable to cheek the conclusions by repeating 
the experiment. 

EXPLANATION OF STEPS IN PLAN 

First. School results are complexes. Many factors' usually 
contribute to a single result. In a control experiment only one 
factor should be varied and studied in order to determine the effect 
of that factor; as, for example, the proper distribution of time in 
teaching penmanship. Assume that sixty minutes a week may be 
devoted to the teaching of penmanship in the fifth grade. The fol- 
lowing question arises: " Shall this time be divided into five 12- 
minute periods a week, four 15-minute periods, three 20-minute 
periods, or two SOminute periods?" An experiment designed to 
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answer suet a question should provide for four groups of fifth-grade 
pupils, each working with one of the suggested distributions of the 
60 minutes per week to be devoted to penmanship. It may be that 
a different distribution of time would be advisable in other grades. 
Hence, similar questions remain to be answered for grades below 
and above the fifth. 

A second question and one entirely different from the one above 
is, " What is the number of minutes a week in each grade that 
secures best results in the teaching of penmanship ? ?> Note that 
this is an entirely different question from the first and cannot be 
studied at the same time without confusion of results. 

Still a third problem: {( To what extent can progress in writ- 
ing be secured without regular drill periods in the various grades?" 
TMs problem involves entirely different elements from the first and 
second problems and cannot be studied in connection with them. 
One factor only in a situation can be successfully studied at a time. 

A pupil's ability in any subject is not a single general ability 
but the resultant of several special abilities. For example, in arith- 
metic there are an almost unlimited number of abilities, as ability 
in adding long columns, short columns, small numbers, large num- 
bers, etc., different abilities in subtracting, multiplying and divid- 
ing whole numbers ; different abilities in operations in fractions, as 
in adding, subtracting, multiplying, dividing, reducing, etc. A 
given control experiment can deal with only a single ability or a 
single factor in a situation. The science of education will be per- 
fected by solving correctly the numerous small problems involved 
in the educative process, as successful manufacturing is perfected 
by handling correctly each detail of its work. 1 

Second. In the type experiments to which I have referred 
in the preceding paragraph, the number of pupils is not large. 
Larger numbers of pupils add to the reliability of the results, al- 
though they make more difficult the control of all the factors; in- 
volved and the maintenance of constant or standard conditions. 



reader is referred to the January, 1912, number of the Teachers Col" 
lege Record for a detailed study of the "Separate" and "Together" methods 
of teaching homonyms. Here there is a splendid illustration of a well-organized 
and a well-conducted control experiment. The Teachers College Record for 
September, 1913, has another good example of a control experiment on the ques- 
tion of "Formal English Grammar as a Discipline." 
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Moreover, when the number of pupils Is large, the handling of the 
statistical work becomes very laborious. Accordingly, more trust- 
worthy results may often be secured by the repetition of the experi- 
ment in other school systems under standardized conditions. 

The groups should be equal in ability because groups having 
low initial scores usually make large numerical gains with less ex- 
penditure of effort than do groups having high initial scores. When 
equal gains are expressed as percentages they seem much greater 
when based on low initial scores than- when based on high initial 
scores. Percentage comparisons based upon unequal initial scores 
are thus very deceptive. Suppose that one fifth-grade group has an 
average initial speed of 50 letters a minute and the other of 75 let- 
ters a minute. An average gain of 10 letters a minute in each grotip 
appears to be an equal gain ; but when expressed in percentage form 
it is 20 percent for the slow group and 13^ percent for the rapid 
group. Thus the slow group has the higher percentage of gain. 
Yet anyone at all familiar with the teaching and learning processes 
in school knows that a gain of 10 letters in the rapid group is a much 
greater achievement than is a gain of 10 letters in the slow group. 
Hence the importance of having the groups of equal initial ability 
in order to estimate rightly the improvement. It is well that the 
sex distribution in the groups be equal and that the previous train- 
ing and home environment be as nearly equal as possible. Espe- 
cially is this equality important when small groups are used. If 
several classes, selected at random, are used in each group, varia- 
tions in conditions in the different classes will tend to neutralize 
each other. 

Third In measuring the skill or ability of pupils, care must 
be taken that the tests measure the ability that is being studied, and 
that they are given under uniform conditions. No detail is too triv- 
ial to be considered. For example, a principal who was giving a 
test in arithmetic found a room in disorder because it was tempor- 
arily in charge of a substitute who was poor in discipline. Before 
giving the test he administered a, sharp reproof to the pupils. Al- 
ready in a bad attitude, they were humiliated by the reproof and 
failed to respond properly to the test. An equivalent one, givepi a 
few days later in the same room, secured far better results. Not only 



SUGGESTIONS FOS EXPERIMENTAL WQSK 145 

must directions be followed exactly, and uniformity of procedure be 
maintained in all rooms, but also tlie proper attitude of pupils must 
be secured. Note In Dr Brlggs' study on ct Formal Grammar 7 ' that 
lie administered the test to both groups at the same time, thus in- 
suring uniformity. 

In almost every measurement of school achievement, both quan- 
tity and quality must be considered. Thus in handwriting we meas- 
ure both the rate and the quality of the writing. The customary 
directions for a handwriting test are: " Write as well as you can 
at your usual rate of speed the following sentence. Write the sen- 
tence again and again until I say 'Stop V Suppose the teacher 
adds as a final suggestion, "Now, do your best, children"; the 
rate will then generally be reduced materially and the quality im- 
proved only slightly. In one room this added suggestion reduced 
the usual speed nearly fifty percent. From these comments it is 
evident that the results would be more trustworthy if the same per- 
son gave both the Initial and final tests. In measuring school 
achievements, group measurements are usually taken, since forty 
pupils can be tested in a group in about one-fortieth of the time 
required to test each pupil individually. In some cases, as in oral 
reading, individual tests are necessary. Usually the amount of 
time required to give individual tests limits such tests to a very 
small number of pupils. 

In testing groups the time-limit method is generally used ; that 
is, rate or speed is measured by the amount of work done in a given 
time. In such tests, absolute uniformity of time is essential. For 
keeping time, a stop-watch is desirable, or at least a watch with a 
second hand. 

When individuals are tested, the work-limit method may be 
used. According to this method each pupil is given the same amount 
of work and his performance is measured by the time required to 
do it. Individual testing by the work-limit method is doubtless 
preferable to group testing by the time-limit method, but it is sel- 
dom practicable in ordinary classroom work. 

Fourth. The preceding paragraphs indicate the wisdom of the 
directions with regard to teachers. Unless teachers are open-minded, 
they will vitiate results. A teacher who feels that she must prove 
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tliat the method or book that she is using Is superior to the other 
method or book will unconsciously destroy uniformity of conditions. 
Unless teachers have a scientific attitude, they will fail to appre- 
ciate the value of many of the requirements in the experiment 
and are likely to feel that a failure to get highly satisfactory re- 
sults is a reflection upon them rather than upon the method. To 
maintain their own reputations as teachers, they must make the 
method successful. In order to do this they prevent the standard- 
izing of conditions. Unless teachers follow directions conclusions 
will be worthless. 

Fifth. In addition to the detailed instructions in the hands 
of the teachers, conferences with them are also desirable. 

Sixth. As far as possible, all factors except the one under 
consideration should be kept uniform or standardized for all 
groups. For example, in the suggested study on "Time Distribu- 
tion in Teaching Handwriting," no home study or practice on 
handwriting outside of school should be allowed, for such practice 
cannot be made uniform. No attention should be given to hand- 
writing in other subjects, otherwise varying factors will be intro- 
duced; all practice in and teaching of handwriting should be done 
during the sixty minutes a week. All other work should be as 
nearly identical as possible. In the period between the initial and 
final testing, the quality of the teaching of the different groups 
should be, as nearly as possible, the same. It is difficult to select 
teachers of equal ability ; but by alternating them, or by repeating 
the entire experiment with similar alternation, the desired result 
may be secured. Sometimes the same teacher may instruct the sev- 
eral groups at different times. 

Seventh. The amount of time required for a control experi- 
ment varies with the nature of the experiment. A few weeks may 
be sufficient to show differences in improvement in spelling or 
handwriting. Several months, a year, or even more, may be needed 
to permit a fair estimate of the value of two methods in reading, 
or the value of kindergarten work. 

Eighth. The same care in measuring the ability of pupils at 
the end of the experiment must be used as was used at the begin- 
ning. The final test must be carefully chosen and must be of the 
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same difficulty as tlie initial test. Tlie opportunity for each group 
to prepare for tMs final test should be absolutely equivalent except 
as to tlie one factor under survey. 

In a general study of tlie school achievements in a system, it 
is easy to be deceived by two measures taken at different times. 
Suppose, for example, that you test pupils in spelling in October, 
using words from the Ayres 7 Scale. Suppose also that the teachers 
of your school have not had access to the Ayres 7 Scale prior to 
this time, but that after the test each teacher has a copy of it and 
drills on the words. Even though at the dose of the experimental 
period you do not use the same words as in the first test, but select 
from the Ayres 7 Scale other words of equal difficulty, it is probable 
that your children will have apparently made great gain. You will 
not, however, have measured the real gain in spelling ability, since 
the pupils have been specially prepared for the second test. 

Ninth. The scoring of results must be absolutely uniform 
and the tabulations made in the same way. The greatest uniformity 
is secured by having the same person do all the scoring and tabu- 
lating. If more than one person participates in this work, specific 
directions must be given to insure uniformity of work. The anal- 
ysis and the correct interpretation of the gains and losses in a con- 
trol experiment are the most important parts of the work. The 
value of a method or of a given material is measured by the gain 
which results from its use. The method of computing this gain 
will depend somewhat upon the character of the factor that is being 
studied. In general, in measuring school achievements, the median, 
as a group measure, has the advantage over other measures. It is 
easily and quickly computed and is not unduly affected by extreme 
scores. These extreme scores are always tinder suspicion. Further- 
more, especially high or especially low individual scores have little 
scientific value in determining, let us say, the efficiency of a method 
of teaching, since what is done by the unusual pupil does not meas- 
ure the value of the method for the great mass of pupils. Very high 
scores or very low scores affect the average much more than they 
do the median. The median, moreover, is likely to represent more 
closely the central tendency. It is often desirable to compute from 
the medians the percentage of gain or loss. "When, however, the 
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percentage of gain or loss for eacJt pupil is reported, the figures are 
misleading, unless the bases (I e., the Initial scores) OIL which the 
percentages are computed are equal. Besides medians and per- 
centages, the distribution of the scores (the frequency of each 
score) must receive careful consideration. The amount and per- 
centage of gain or loss for all pupils having the same initial score 
are valid figures. The measure of the variability of the gains Is 
likewise Important. 2 

Tenth. After every reasonable effort has been made to keep 
the factors uniform during the experiment, varying factors will 
often enter. These must always have consideration and their prob- 
able effects must be estimated. 

Eleventh. A single experiment, even when carefully con- 
ducted, Is often not conclusive. In the report on the 'separate' and 
'together 7 methods of teaching homonyms, to which reference was 
made above, note how guarded Dr. Pearson is in Ms statements. 
So far as his experiment is concerned, certain things are true. 
Another experiment might show different results. 

Twelfth. "When any conclusion of educational value has been 
reached by a single experiment, it should always be possible to ver- 
ify the result by repeating the experiment at another time or in 
another school under the same standardized conditions. This can 
be done only when a careful record has been kept of the plan of 
procedure and of the important controlling factors in the experi- 
ment. 

USES OF CONTROL EXPERIMENTS 

Some of the uses of control experiments have been suggested 
In the preceding discussion. While these uses are various, the fol- 
lowing may be particularly mentioned : 

a. To determine the relative value of two methods of teach- 
ing. 

b. To determine the relative value of two books or two kinds 
of drill material. 

e. To determine the best distribution of a given teaching time. 

2 For statistical methods see Thorndike 's Introduction to Mental cmd Social 
Measurements, Science Press, New York; WMpple's Manual of Mental and 
Physical Tests, Warwick and York, Baltimore, and Bugg's Statistical Methods 
Applied to Education, Hougbton and Mifflin and Company. 
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d. To determine the amount of time needed to secure optimal 
results in a given subject. 

e. To determine the relative value of different organizations 
of subject matter. 

f. To determine the size of classes that will secure optimal 
results. 

g. To compare two types of school organization. 

Possibly these last two are too complicated to handle as an 
ordinary control experiment, but the principles of a control ex- 
periment should be applied. 

A control experiment is simple, but requires a scientific atti- 
tude and the constant use of good judgment and common sense. 
Many experiments of great promise have been rendered valueless 
by the neglect of one or two minor details. It will be a great boon to 
education when the various experiments that are being made in its 
field are placed under sufficiently controlled conditions to render 
the conclusions of scientific value. 

LARGE PROBLEMS 

In addition to the simpler problems suggested above, there are 
many others which are too comprehensive for any school district or 
even for any state to solve alone, and which must, therefore, be 
solved, if at all, by the cooperation of many agencies. Investiga- 
tions concerning types of school organization, length of sessions, 
sizes of classes, evening schools, recreation in and outside of school, 
vocational education and guidance, training of teachers, etc., are 
of too general a character to be satisfactorily made by a single 
agency. Various organizations are working on certain of these 
problems. Among them are the following: 

A. The National Society for the Study of Education. 

B. The National Education Association. 

C. The National Association of Directors of Educational Re- 
search. 

D. The American Association for the Advancement of Science. 

E. Various national organizations for teachers and workers 
in a number of fields. 
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F. Departments of education in universities and normal 
schools. (Some of these institutions have organized cooperative 
bureaus as described in another chapter of tMs Yearbook.) 

GL State departments, some of which have cooperative bu- 
reaus similar to those in universities and normal schools. 

H. Educational Foundations. 

I. United States Bureau of Education. 

The United States Bureau of Education should have a Division 
of Educational Standards and Measurements. This bureau should 
be in charge of a thoroughly trained scientific student of education, 
seasoned by practical and successful school experience, and should 
become a national clearing house for educational experiment. Sev- 
eral lines of work are open to such a bureau. 

First. Testing of Methods. Two methods of teaching could be 
tried in a score or more of rooms in each of one hundred cities. 
The United States Division of Standards and Measurements could 
prepare outlines of experiments, provide both the initial and final 
tests, compile and analyze data from these one hundred cities and 
deduce conclusions that would have general value in educational 
work. The United States Bureau of Education would thus develop 
an influence in the field of education, similar to that exerted by 
the Department of Agriculture in its sphere. Bulletins of the 
United States Bureau of Education would then be read and studied 
by progressive teachers and school administrators as; the Agricul- 
tural Bulletins are now read by leaders in agriculture. Such work 
would enable every community to profit by the experience of other 
communities by adopting the really successful plans and avoiding 
or discarding those found to be unsuccessful. Under present con- 
ditions, however, although a given method may prove unsuccessful 
in a score of communities this year, another group of communities 
may try the same method next year, not knowing that it has al- 
ready failed or been discarded. Thus an unsuccessful method, if 
well-advertised, may gain admittance into many school systems only 
to be east into the educational "junk pile" in time. 

Second. Testing drill material, books, and school appliances. 

Third. Conducting at various points in the United States edu- 
cational experiment stations, and making preliminary tests of cer- 
tain methods before extending their use to other localities. If the 
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vertical system of handwriting had been tested ont for a few years 
in a large commercial center, its shortcomings would have been 
discovered, and it probably wonld not have spread over the country. 

Fourth. Investigating many of the large problems of school 
administration that can be settled only by nation-wide study. These 
studies should be impartial and should not be conducted by en- 
thusiastic advocates of the scheme to be studied. This caution is 
submitted because even the United States Bureau is thought to have 
sometimes fallen under the influence of emotionalists and educa- 
tional promoters. The value of the Gary system, as referred to 
above, is a problem of national importance. The same Bureau 
of Education should be able to make a survey of the Gary Schools 
in operation in various places, and to secure accurate data as to the 
results that are being obtained. In the course of ten or twelve 
years, the country could know the facts with regard to this organiza- 
tion. Kansas City and several southern cities have a seven-year 
course of study in the elementary schools. If it is possible to cover 
the course satisfactorily in seven instead of eight years/ the entire 
educational world should be made aware of this fact by an im- 
partial study of the work of these seven-year systems furnished by 
the United States Bureau of Education. The movement to estab- 
lish junior high schools is well under way. The value of this type 
of organization should be established, and no agency could do so 
better than the United States Bureau of Education. 

"While, therefore, there are many problems, both large and small 
which await solution, the value of the solution of many of them, it 
is urged, would be greatly enhanced if it were made from an au- 
thoritative, impersonal, and national point of view. 



CHAPTER 

A LOOK FORWARD 

CHABLES H. JUDD 
Director, School of Education, University of Chicago. 

A paper dealing with, the future can justify itself in a scientific 
volume of this kind only when it bases itself on an analysis of 
present conditions and aims to develop as a result of such an 
analysis suggestions for improvements and enlargements of the 
movement under discussion. The reader is warned, therefore, at 
the beginning that this paper looks backward as well as' forward, 
in order that justification may be furnished for some of the plans 
urged as desirable for the future. 

One fact which is evident to every student of school problems 
is that the movement toward the development of measurements is 
both promoted and seriously encumbered by a vague popular de- 
mand. Parents have heard that there are methods of finding out 
whether their children can spell or add or read satisfactorily, and 
immediately a clamor arises for a measurement of the local school. 
The demand is likely to be especially keen if there is some parent 
in the community who does not like the superintendent or the prin- 
cipal. Such a parent never for a moment believes that responsi- 
bility for unsatisfactory school results is to be traced to the native 
limitations in the ability of his child or to the home atmosphere 
in which the child grows up. Such a parent is quite certain that 
measurement will detect at some point a lack of perfection, and 
then he knows that his dislike for the school officer will have the 
sanction of science. 

It is little wonder that school superintendents have often been 
afraid to have their schools measured. Especially hazardous is it 
to have the schools measured in many respects in a single survey. 
The number of imperfections sure to be revealed in a general survey 
is appalling. One has the same dread of -going to a dentist to have 

152 



A LOOK FQEWAED 153 

Ms teeth examined, knowing well that one's teeth, are sure to f go 
to pieces' under the keen scrutiny of the expert. The case would 
be still worse for most of us if we were obliged to submit the im- 
perfections of our features to the relentless analysis of an expert 
in physiognomy. 

In the presence of a popular demand for the revelation of im- 
perfections and the absolute certainty that imperfections exist, it 
is not difficult to understand why there should be a tendency on 
the part of many school officers to combat the movement toward 
wide-spread measurement. 

The future is sure to develop a new and more wholesome atti- 
tude on the part both of the public and of school officers. Indeed, 
the measurements which have been made up to this time have more 
than justified their cost in effort and money, because they have dis- 
pelled forever the idea that schools should produce a uniform 
product or one that, is perfect in its attainments. We all under- 
stand now in definite scientific terms that children are different 
from one another, that the lower grades progress slowly toward 
satisfactory results, that movement within the school is purchased 
at great expenditure of labor on the part of all concerned, and that 
the best we can hope for is improvement not absolute achievement 
of ideals. 

With the theoretical ideal of perfection overthrown, there is 
now an opportunity to set up rational demands. We can venture 
to tell parents with assurance that their children in the fifth grade 
are as good as the average if they misspell fifty percent of a certain 
list of words. We know this just as well as we know that a certain 
automobile engine cannot draw a ton of weight up a certain hill. 
No one has a right to make an unscientific demand of the automobile 
or of the school. 

As soon as school officers recognize the fact that! measurements 
define for them just how much may reasonably be demanded, they 
will be unafraid of measurements. Indeed, they will learn the ad- 
ministrative lesson that it is better to know for purposes of ordinary 
routine what ought to be demanded than merely to guess at condi- 
tions. The writer once heard a business man put the matter very 
clearly. He was looking at some diagrams that showed the results 
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of a study of schools. "This/ 7 lie said, "is the sort of thing busi- 
ness has learned to do. We used to be offended if anyone criticised 
our methods or commented on our results. Now we know that our 
best friend is the man who comes and tells us exactly where we 
stand. The one thing business cannot approve is ignorance about 
results. We do not fool ourselves any more, come what will of the 
revelation." 

The school principal who knows in advance where Ms school 
is weak and where it is strong, is armed against criticism. But 
more than that, he is guided in his future efforts. The purely nega- 
tive result that adverse judgment causes no shock, is of some im- 
portance, but the positive result that the school is stimulated to 
improve itself is a matter of supreme advantage. If we can devise 
methods of knowing ourselves, we shall take np the tasks of self- 
improvement with assurance and with discrimination. 

The first prophecy, then, which one can venture with a good 
deal of assurance is that school officers will learn to anticipate popu- 
lar demands and will thereby come into possession of information 
which will guide them in their own work. 

A second general fact about measurement is that up to this 
time it has dealt with very broad problems and usually has grouped 
together great masses of results. This is seen in the fact that one 
speaks in a large way about medians of thousands of cases. The 
sheer breadth of our studies has intimidated teachers. They feel 
that the machinery is set up to deal with systems of schools, but not 
with their detailed problems. 

It is natural enough that the beginnings of this science should 
concern themselves with broad, remote facts. So it has always been. 
The race developed astronomy first because celestial facts are re- 
mote and on a vast scale. It is only in the latter days of refined 
scientific study that we have come to know details about our own 
bodies and the facts of social organization. 

Thanks to the energy which has been expended in scientific 
work, we have the gross methods well in hand. Eefinement of 
methods has begun. Formerly we used to compare school system 
with, school system. We shall continue this, but we can now begin 
to use our methods for the more specific study of individual cases. 



A LOOK FOMWAXD 155 

Take, for example, the refinements which Ayres lias added to Ms 
last writing scale. Along the bottom are the figures which tell the 
teacher in detail how speed and quality are distributed in the normal 
class. There is in this refinement a larger recognition of the teacher 
and of the classroom contact between teacher and pupil. One can 
not help recognizing that measurement is becoming surer of itself 
and is taking up details. The broad first facts have been collected 
and formulated. Now there is a penetration to the deeper problem 
one is almost tempted to say to the real problem. 

As soon as teachers learn the possibility of using definite meas- 
urement to solve their individual problems, they will share with 
superintendents the attitude which was described above of wanting 
to uncover the exact facts. Here, for example, is a difficult pupil. 
How far is he behind the class at the opening of the school year? 
How rapidly does he progress ? Whatever the answer, the teacher 
will be aided in directing the pupil's work if that answer can be 
known with definiteness and detail. 

Everywhere there are indications that measurements are to be 
used by the teacher. The results of supervised study are being 
measured. The results of different methods of teaching are being 
accurately determined. Thus, different systems of reading, differ- 
ent methods of teaching long division, and different methods of 
manipulating the decimal point are being studied. 

Up to this time, teachers, partly because they shared the dread 
of measurements and partly because they thought of measurements 
as remote, have stood aloof from the movement. Now there appear 
the beginnings of a tendency to make measurement a part of the 
class routine. The arithmetic lesson serves at once as a drill exer- 
cise and as an opportunity for measuring results. The rhythmical 
beating of time in writing helps in the formation of a habit and 
tells the teacher what members of the class, if any, are lacking in 
skill. The measurement of rate in reading helps the teacher to 
decide which members of the class require special attention. 

These beginnings mark the path along which the measurement 
movement must travel in the coming years. There is need of new 
energy in devising methods of class routine which will bring to the 
teacher the exact results which will show how successful has been 



156 THE SEVENTEENTH YEARBOOK 

the work of the class and of the individual. Those who complain 
that the teacher does not have time to make measurements miss the 
point entirely. The teacher often wastes time and effort under exist- 
ing conditions because of Ignorance of the direct point where appli- 
cation of teaching energy would be most effective. The right kind of 
classroom measurements, as suggested in the examples cited above, 
do not interrupt class routine at all, but contribute exact methods 
of procedure at the same time that they reveal to the teacher where 
the class stands. 

A conception such as that given in the last paragraphs will also 
clear up another difficulty which teachers sometimes point out. 
They complain that the volume of experimentation is so great that 
the class exercises are disorganized and disrupted. The advice 
which ought to be given to a teacher who makes this complaint is 
that one kind of class exercise should be transformed at a time. 
Methods should be built up in each subject which serve both the 
purposes of measurement and of teaching. This can be done, but 
it requires readjustment and planning. 

The second prophecy which one may venture is, accordingly, 
that measurement will more and more take up details and will be- 
come a common instrument in the hands 1 of the classroom teacher. 
One objection which has been urged again and again against 
measurement is that it deals only with the formal and mechanical 
aspects of education. This objection has nowhere been more defi- 
nitely stated than by Superintendent Horn in his Supplementary 
Survey of Portland Public Schools where he writes as follows : 

"It should furthermore be kept in mind that there are many 
things about a school system which can never be definitely measured 
or stated with mathematical accuracy. Just where the line is to 
be drawn between the measurable and the non-measurable elements 
that enter into a school is a matter concerning which there is much 
difference of opinion. In other words, the element of opinion enters 
to some extent even into the matter of the possibility of measure- 
ment. 

"For instance, it is an undoubted fact that any man can go 
into a city and count the school houses or the number of the desks. 
Any man can find out the number of teachers employed. Any man 
ca.n count for himself the number of pupils present in a given room. 
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lt lt takes no particular ability to enable an inquirer to find 
out just how mueii money is being spent. If the schools spent nine 
hundred thousand dollars in one year and a million dollars the 
next year, any one can deduce the fact that they spent one hundred 
thousand dollars more the second year than the first year. 

4 * On the other hand, after a comparatively few such facts have 
been definitely ascertained, we come to subjects that cannot be 
measured in mathematical terms, and concerning which there are no 
definite standards. In this realm ideals are not always definitely 
established and opinions are almost certain to vary widely. 

For instance, if you take two classes, one across the hall from 
the other, who can decide in which of the classes the higher 
ideal of truthfulness or honesty prevails? Who can say which 
teacher is more successful in making the children self-reliant, and to 
what extent ? We all know that in such a case, if the two teachers 
are both fairly good, many pupils and patrons will consider one 
the better teacher, while many others will consider the other the 
better. Especially will this be true with reference to such matters 
as the teaching of honesty, industry and self-reliance. Incidentally, 
these very things are recognized as being among the most important 
of ail the elements entering into the question of the teacher's effi- 
ciency. A school that turns out manly, honorable, self-reliant boys 
and womanly, efficient girls is likely to be at least a fairly good 
school, no matter what it may do otherwise. A school that fails 
to turn out such pupils can hardly be considered a good one, no 
matter what it may do for its pupils in the way of reading, or 
writing, or arithmetic. And yet these very things, which may de- 
cide between the success or failure of the school, are matters; which 
it is almost impossible to estimate accurately, and concerning which 
there may be a wide amount of honest difference of opinion." 1 

The success of the measurement movement depends on its abil- 
ity to meet this type of objection. 

Some of us might be entirely willing to rest the case after ask- 
ing whether in practical school life anyone ever saw a teacher thor- 
oughly competent in teaching ideals but neglectful of reading and 
arithmetic. The fact is that the conscientious teacher always gives 
attention to both, and the successful teacher is able without omitting 
one to cultivate the other. The theoretical possibility of thinking 
of the two results separately has little significance in dealing with 
real teachers and real schotols. Good reading is a school virtue, and 
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when one has measured good reading, lie has measured more than 
the trivial or formal side of education, 

The hope of the measurement movement is, however, to do more 
than to deny the validity of snch criticism as Mr. Horn makes. 
There is to be progress in covering more fully the details of school 
work Today we know how to measure many aspects of teaching. 
The reason for our early attack on the formal elements is that these 
yield readily to analysis and thus to theoretical isolation and exact 
treatment What we need to do is to carry our analysis further 
and then new measurements will become easier, 

A few years ago reading tests seemed impossible. Today we 
have mastered the distinction between oral and silent reading. We 
have good methods of measuring some of the more common types 
of deficiency and we know the rate of progress which is normal in 
the more obvious phases of interpretation. The progress in this 
field within a single year is so large that there is nothing but opti- 
mism in the minds of those carrying on the work. What we need 
is more interest on the part of practical workers and more experi- 
mentation with methods. 

Those of us who have watched the progress of measurement 
will recall distinctly that the earliest critics of the movement were 
more emphatic than the present-day critics in declaring that school 
results could not be measured. This type of criticism was the one 
with which Mr. Kice's opponents thought they had forever elimi- 
nated him and his type of work from the schools. Steadily the 
range of measurements has broadened. Steadily the productivity 
of the movement has increased. It is not for the advocate of the 
movement to prophesy its limits ; it is perfectly safe for him, how- 
ever, to assure all the world that the end is not yet in sight. So 
long as advantage com.es from the pushing forward of this move- 
ment, so long as ingenuity is at hand to devise new modes of pro- 
cedure, the answer to the objection that measurement is limited to 
a few trivial aspects of teaching is steadily becoming more cogent. 

This hopeful conclusion is fully supported by one fact which 
serves at the same time to reveal one of the most important ad- 
vantages of measurement, namely, the fact that with the develop- 
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merit of measurement there is coming into education a greater gen- 
eral clearness and definiteness of purpose. 

An example will show what is meant. In the high school of 
Kansas City, Kans., there is a system of telling the students defi- 
nitely and in detail what they must do if they want to secure the 
higher grades, A or B y in a given course. The very fact that students 
in that school have all along been given A, B, and C shows that 
measuring of all sorts of intellectual and moral qualities has been 
going on. The interesting fact is that in most places the measuring 
is vague and often unsatisfactory, because no one has taken the 
pains to define what is wanted. Students know that teachers are 
often arbitrary, and, be it confessed, teachers also know that they 
are vague. The system referred to above removes some of the 
ambiguities. It improves the measuring system, making it definite 
and exact, because it analyzes and defines the elements of work 
demanded. 

Suppose that the teachers of a school should concentrate for 
half a year on cultivating the power of concentration of attention. 
Is there any doubt that much new information would be gained 
about concentration and that there would be more accurate methods 
of determining its degree ? Measurement will be extended in the 
future. The reasons why one can be so sure about this statement 
are to be found in the history of the past few years. 

The third prophecy that can be made is, therefore, that the 
scope of measurement will be widened until it is sufficiently in- 
clusive to satisfy even the most exacting critic. Concentration of 
attention, ability to attack various kinds of problems, clearness of 
insight, power of inference in various fields will be measured. The 
demand again is for workers who wiU give themselves the training in 
analysis and take the pains in collecting material that is necessary 
to bring about this consummation. 

It may be unscientific to prophesy about the remoter social 
consequences of such a movement as we are discussing, but certain 
final observations may serve to show why the advocates of measure- 
ment in education are unlimitedly optimistic. The time is rapidly 
passing when the reformer can praise Ms new devices and offer as 
the reason for his satisfaction, his personal observation of what was 
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accomplished. The superintendent who reports to his board on 
the basis of mere opinion is rapidly becoming a relic of an earlier 
and unscientific age. There are indications that even the principals 
of elementary schools are beginning to study their schools by exact 
methods and are basing their supervision on the results of their 
measurements of what teachers accomplish. A social change of 
this kind is adequate justification for any movement and a sufficient 
guarantee for its continuance. 
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594a. Texas. The State Institutions of Higher Education in Texas. By the 

Educational Campaign Committee, Austin, Texas, 1912. 
594b. Texas. A Survey of Eural Schooils in Travis County, Texas. By E. E. 

Davis, Austin, Texas, 1916. 

595. Vermont. Secondary Education in Vermont. By E. McFarland. Mid- 

dlebury. 1912, pp. 42. 

596. Vermont. Education in Vermont. Carnegie Foundation for the Ad- 

vancement of Teaching Bulletin No. 7, Pts. 1 andj 2, 1914,) pp. 214. 
596a. Vermont. Report of the Commission to Investigate the Educational Sys- 
tem and Conditions of Vermont. Brattleboro*, 1914. 

597. Virginia. Eeport of the Virginia education commission to the General 

Assembly of Virginia, the Commonwealth of Virginia. Senate Docu- 
ment No. 3', 1912, pp. 102. 

598. Washington. A survey of educational institutions of the state of Wash- 

ington. U. S. Bureau of Education Bulletin, No. 26, 1916, pp. 228. 

599. Wisconsin. Report of the Commission^ upon the Plans for the Extension 

of Industrial and Agricultural Training. Madison, 1911, pp. 135. 

600. Wisconsin. Preliminary Report on Conditions and Needs o\f Mural 

Schools in Wisconsin. State Board of Public Affairs, Madison, 1912, 
pp. 92. 

601. Wisconsin. Preliminary Eeport of the Committee of Fifteen Appointed 

to Investigate Educational Need$ and Conditions in Wiscomw. C. P. 
Gary, Madison, 1912, pp. 30. 

602. Wisconsin. J&eport upon the Survey of the University of Wisconsin. 

State Board of Public Affairs, Madison, 1914, pp. 957. 

602a, Wisconsin. Conditions and Needs of Wisconsm Normal Schools. State 
Board of Public Affairs, 1914. 
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603. Wisconsin. Survey Summary re University of Wisconsin. Wisconsin 

Efficiency Bureau, Madison, 1915, pp. 105. 

604. Wisconsin. The Milwaukee County School of Agriculture and Domestic 

Economy. By Walter Matscheck. Madison, 1916, pp. 73. 

605. Wyoming. Educational survey of Wyoming. By A. C. Monahan and 

Katherine M. Cook. U. S. Bureau of Education Bulletin, ISTo. 29, 
1916, pp. ISO. 

606. United States. A Comparative Study of the Public School System in the 

Forty-Eight States. Eussell Sage Foundation, N~ew York, 1912, pp. 32. 



NATIONAL ASSOCIATION 

OF 

DIRECTORS OF EDUCATIONAL RESEARCH 

CO N STI TUTION 

ARTICLE I 

Name. Tlie name of this organization shall be the National Association 
of Directors of Educational Research. 

ARTICLE II 

Object. The object of the Association shall be: (1) the formation of 
independent departments of educational research in all systems of public in- 
struction, and (2) the promotion of the practical use of educational measure- 
ments in all educational research having for its object the improvement of the 
efficiency of the educational administration, supervision or teaching, 

ARTICLE III 

Membership. SECTION 1. In general, membership in the Association shall 
be restricted to those who are actively and mainly engaged in research work 
having for its direct purpose the evaluation of the products of educational 
training or the improvement of the efficiency of educational teaching, super- 
vision or administration. 

SEC. 2. Membership in the Association may be either regular or associate. 
Regular members shall have any and all of the rights and privileges of the 
Association, including the right to vote, to hold office, and to appear upon any 
foirmal or informal program, of the Association. Associate members are not 
eligible for office, have no vote and may not appear in any formal program of 
the Association, or otherwise represent th Association in public meetings, with- 
out special invitation of the Executive Committee ; but they are to receive all 
bulletins of the Association, to be notified of all meetings or other activities 
and no distinction is to be made in any informal meeting or prograni between 
them and regular members. 

SEC. 3. Any person holding the position of Director of, or supervising, a 
Department of Educational Research in an educational institution, or any im- 
mediate assistant of such director, shall be eligible for full membership. 

SEC. 4. Any person actively engaged in research work in education, but 
holding some educational position other than in a department of research shall 
be eligible for associate membership. 

SEC. 5. The Executive Committee, through the Secretary, shall, if neces- 
sary, ask all applicants for membership to state their positions, duties and 
past achievements in measurement work, and decision as to eligibility shall 
be made by the Executive Committee. In all cases where the applicant holds 
two or more positions, one of which has to do with educational research, the 
decision of the Executive Committee shall be made in accordance with the in- 
tent of the qualifications for membership as outlined above. Regular members 
who have not contributed to the bulletins of the Association during the year 
shall automatically become associate members at the annual meeting next fol- 
lowing. 
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AETICLE IV 

Dues and Assessments. There shall be no regular annual dues. The ex- 
penses incidental to carrying- on the work of the Association shall be met by 
an assessment voted at each regular annual meeting. 

AJ&TICLE V 

Officers. The officers shall consist of a president, a vice-president, and a 
secretary-treasurer. These officers shall be elected at the regular annual meet- 
ing of the Association. Their duties shall be those usually performed by such 
officers. 

ARTICLE VI 

Executive Committee. There shall be one executive committee of five mem- 
bers consisting of the officers and the two preceding presidents whose duty 
shall be the conduct of the business of the Association between meetings. 

ABTICLE VII 

Meetings. The time and place of holding the annual meeting shall be 
determined by a vote of the Association. Special meetings of the Association 
or of the executive committee may be called by the president, and must be 
called by him whenever requested by a majority of the executive committee. 

ARTICLE VIII 

Amendments. Changes in this constitution may be mad at any annual 
meeting of the Association by the affirmative vote of two-thirds of the mem- 
bers present. 



MEMBEKSHIP 

OFFICERS, 1917-18 

President S. A. Courtis 

Vice-president B. B. Buckingham 

Secretary George W. Melcher, Library Bldg., Kansas City, Mo. 

EXECUTIVE COMMITTEE 

F. W. Ballou (President '1915-16), W. S. Monroe (President 1916-17), S. A. 
Courtis, B. B. Buckingham, George W. Melcher. 

HONORARY MEMBERS 

Hon. J. M. Bice, Germantown, Pa. 

Dr. Paul H. Hanus, Harvard College, Cambridge, Mass. 

Dr. E. L. Thorndike, Teachers College, Columbia University, New York City. 

Dr. Charles H. Judd, University odP Chicago, Chicago, HI. 

BEGULAR MEMBERS 

Allison, Samuel B., Asst. Superintendent in charge of Standards and Statistics, 
Chicago, 111. 

Anderson, Homer W., Educational Besearch Public Schools, 508 City Hall, 
Omaha, Neb. 

Ashbaughm, Ernest J., Educational Service, Extension Division, University of 
Iowa, Iowa City, Iowa. 

Averill, William A., State Department of Education, Albany, New York. 

Ayres, Leonard P., Director Division of Education, Bussell Saga Foundation, 
New York City. 

Ballou, Prank W., Director Department of Educational Investigation and 
Measurements, Mason Street, Boston, Mass. 

Bright, Ira J., Director of Beseaxch and Efficiency, Public Schools, Topeka, 
Kansas. 

Bmeekner, Leo J., Department of Educational Besearch and Martindale Normal 
School, Detroit, Mich. 

Buckingham, B. B., Educational Statistics State Board of Education, Madison, 
Wis. 

Burns, Allen T., Director Cleveland Foundation, Cleveland, Ohio. 
Clark, Earle, Statistician, Bussell Sage Foundation, New York City. 

Courtis, S. A., Director Department of Educational Beseareh 82 Eliot Street, 

Detroit, Michigan. 
Davenport, Harry L., Director Division of Besearch and Statistics, Schnectady, 

N. Y. 

193 



194 TEE SEVENTEENTH YEARBOOK 

DeVoss, J. C. 3 Assistant, Bureau of Standards and Measurements State Normal 
School, Emporia, Kansas. 

Dickson, Virgil E., Acting Director of Eeference and Research, Public Schools, 
Oakland, CaL 

Flemming, Oeeile White, Assistant Bureau of Educational Measurements, State 
Department of Education, Madison, Wis. 

Fordyce, Charles, Dean Teachers College and Director of Bureau of Educa- 
tional Measurements, University of Nebraska, Lincoln, Neb. 

Haggerty, M. E., Director of Bureau of Cooperative Research, University of 
Minnesota, Minneapolis, Minn. 

Halsey, G. D., Director of Educational Eesearch and Yocational Guidance, At- 
lanta, Ga. 

Hebden, Edwin, Director Bureau of Statistics and Beseareh, 714 Euclid Avenue, 
Eoland Park Branch P. O., Baltimore, Md. 

Kelly, F. J., Dean School of Education and Director of Bureau of School 
Service, University of Kansas, Lawrence, Ks. 

Lane, Robert E., Bureau of Research & Efficiency, Los Angeles, Cal. 

Mackay, William A., Director of Research, Buffalo, N. Y. 

Meleher, George, Director of Bureau of Research and Efficiency, Library Build- 
ing, Kansas City, Mo. 

Monroe, Walter S., Director of Bureau of Educational Standards and Meas- 
urements, State Normal School, Emporia, Kansas. 

Nifeneeker, Eugene A., Assistant Director Division of Reference and Research, 

500 Park Avenue, New York City. 
O'Hern, J. P., Assistant Superintendent of Schools and Director of Efficiency 

Bureau, Rochester, N. Y. 

Phelan, W. W., Director of School of Education and Measurements and Effi- 
ciency, University of Oklahoma, Norman, Okla. 

Race, Henrietta V., Director Psychological Clinic, Board of Education, Louis- 
ville, Ky. 

Richardson, Arthur H., Russell Sage Foundation, New York City. 
Richardson, J. Wylie, Educational Research Director, Hibbing, Minnesota. 

Sharpleigh, P. E., Research Secretary, Buffalo Public Educational Association, 
Buffalo, N. Y. 

Sutton, Clarence W., Director of Reference and Research, Cleveland, Ohio. 

Talb^rt, Wilford E., Assistant in charge Bureau of Educational Investigations, 
677 Melville Avenue, Palo Alto, Cal. 

Theisen, W. W., Supervisor of Educational Measurements, State Department 
of Education, Madison, Wis. 

Welles, J. B., Assistant Director of Reference and Research, Cleveland, Ohio. 

INVITATION 

The Association urges all persons professionally engaged in educational 
research having for its purpose the improvement of the efficiency of school work, 
to join the Association and lend the influence of their names and positions to 
the efforts of the Association to stimulate the growth of the movement. 



ANNOUNCEMENT OF YEARBOOKS AND EXPLANATION 

OF MEMBERSHIP IN THE NATIONAL SOCIETY 

FOR THE STUDY OF EDUCATION 

The purpose of the National Society is to promote the investi- 
gation and discussion of educational questions. Anyone who is 
interested in receiving its publications may become a member. The 
Yearbooks are issued in several Parts each year and are discussed 
at the annual meeting, which is held in February at the same time 
and place as the meeting of the Department of Superintendence 
of the National Education Association. There are two types of 
membership, associate and active. Associate members pay $1.00 
annually and receive one copy of each Yearbook. Active members 
pay $2.00 annually, receive two copies of each Yearbook, and are 
eligible to vote and hold office in the Society. 

The Yearbooks deal in a practical way with fundamental cur- 
rent issues in instruction and school administration. The Seven- 
teenth Yearbook (calendar year 1918) will comprise Part I, to 
contain the tc Third Report of the Committee of the National Edu- 
cation Association on the Economy of Time,' 7 and Part II, to con- 
tain thirteen chapters on ''The Measurement of Educational Pro- 
ducts," prepared by the National Association of Directors of Edu- 
cational Research. Both Part I and Part II may be expected in 
February, 1918. 

Orders for Yearbooks for 1917 or earlier or for single parts of 
the Yearbook for 1918 are handled directly as commercial sales, by 
the Public School Publishing Co., Bloomington, Illinois, at the rates 
indicated on the cover of this monograph. To obtain the entire 
Yearbook for 1918 as a member of the Society, pin your check or 
postal order to the following slip, properly filled out, and mail to 
the Secretary now. 

APPLICATION FOR MEMBERSHIP 

To GUY M. WHIFFLE 

Secretary of the National Society for the Study of Education 
The University of Illinois, Urbana, Illinois 

active ] 

Please enroll me as an v member 

associate ) 

. _ J $2.00 as payment of active dues for calendar year 1918 
in o^ ^ $1 0o ag payment of associate dues for calendar year 1918 

Name 

Address to which | 
to mail > 
Yearbooks j 
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